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with infrequently used grammatical functions. Findings showed that 
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difficulty in cc !i: p rehendin g the infrequent grammatical functions than 
the more usual grammatical ones. It was concluded that acquisition of 
lexicogr ammat ical information about grammatically ambiguous words is 
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knowledge is moderately well correlated with general vocabulary 
knowledge. It is recommended that English curriculums pay greater 
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functions of ambiguous words, (Author/JMC) 
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PREFACE 
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SUMMARY 



The aim was to study the development of children's lex ic ©grammatical 
knowledge of words, in particular, their knowledge of the less frequent 
grammatical usages of words that may occur in more than one part of speech. 
To develop lists of such words, the grammatical functions of 1220 common 
words drawn from two word-counts were examined; about 50 percent were 
found to be grammatically ambiguous. Data were collected from about 1500 
children in grades 5, 6, and 9 to determine in what parts of speech 240 
grammatically ambiguous words would be used when the children were asked 
to write sentences illustrating their uses; about 55 percent of these 
words were found to be used "infrequently" (according to a certain criter- 
ion) in one or more of their possible parts of speech. An intensive study 
was made of the comprehension, by 2000 3rd, 6th, and 9th grade children, 
of 65 words with infrequently used grammatical functions . For about 90 
percent of these words, it was found that the children had significantly 
more difficulty in comprehending the infrequent grammatical functions than 
in comprehending the more usual grammatical functions. In many cases, 
grammatical function per se was a significant factor; in other cases, dif- 
ferential meanings of che words may also have been a factor. Developmental 
trends were noted, and it was concluded that acquisition of lex ic ©grammati- 
cal information about grammatically ambiguous words is a slow process that 
is far from complete even at the 9 th grade level. Development of this 
knowledge is moderately well correlated with general vocabulary knowledge. 
Because lack of lexicogrammatical information is an important (and generally 
unrecognized) factor in comprehension difficulties, it is recommended that 
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the English language arts curriculum pay greater attention to the explicit 
teaching of the less frequent grammatical functions of grammatically 
ambiguous words. The psycholinguistic implications of the results are 
discussed. 
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Chapter I 



Introduction 



Background 

A great many words in the English language can be used in a variety 
of grammatical functions. For example, the common word like can be used 
in several senses as a noun ("He had his likes and dislikes"; "We won't 
see his like again 11 ), as a verb ("I like tomatoes") "Come when you 2 ike " ) . 
as an adjective ("He is like his father"; "Do it in like manner"), and as 
a preposition ("He worked like a horse"). Colloquially, it is used also 
as a conjunction (as in "Tell it like it is" and in a currently popular 
ad slogan, taste like a cigarette should"), and as an adverb ("He 

was kinda skinny, like ") . But like is only one of very many words that 
exhibit vhat we may term grammatical ambiguity . Sometimes a grammatically 
ambiguous word carries the same basic sense in all its grammatical 
manifestations, for example, the word alert (noun, verb, adjective), but 
sometimes a number of different senses are found, as in the word present 
(for which several senses, "gift," "offer, hand to" and "current time" 
are found in noun, verb, and adjective usages). 

Grammatical ambiguity is found in words in both spoken and written 
form. If anything . : Mguity is more frequent in the spoken forms of words 
than in the written forms, for often the spelling of a word is a cue to 
its grammatical part of speech (e.g., pear is a noun, while the homophonous 
pare is a verb) . In the research to be presented here, p'*actical consid- 
erations have dictated that the study be limited to the grammatical 
ambiguities in print ed words, The grammatical ambiguities of spoken words 
could be made the subject of a further investigation, 

o 
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Ambiguity in language can lead to difficulties in comprehension, 
either because the language user does not have sufficient context to 
disambiguate the message (i.e., decide in what senss it is to be taken), 
or because the language user has not learned the meaning or sense in 
which a given word is used in a particular message. The first case is 
illustrated by a flatly ambiguous sentence like Tima flies like an arrow , 
which could be taken in several ways depending upon whether time is 
construed as a noun, a verb, or an adjectival. The second case is 
illustrated by an instance in which a professional acquaintance of the 
writer's, even though highly educated, did not recognize that the phrase 
u an earnest of his intentions '' is grammatically coriect, because he did 
not know that earnest can be used as a noun, with a special meaning, as 
well as an adjective. 

One aspect of the competence of a language user is his knowledge of 
the grammatical functions of lexical items. We knot' very little about how 
children acquire this knowledge, or indeed, how much knowledge they acquire 
an t what rate. If children fail to acquire an adequate knowledge of 
the grammatical functions of the words in their vocabulary, it is likely 
that they wil,” not understand language as well as they might. 

This research was designed to yield information concerning the 
development of children's knowledge of the grammatical functions of printed 
words in English, and to see to what extent any lacks in this knowledge 
might inhibit their understanding of language. 

The motivation for this research was both practical and theoretical. 

On the practical side, it seems obvious that any information that could 
be gained concerning developmental trends in languige under standing would 
be of use in promoting the growth of language comp5*:ence through education. 
O ators have found much use for vocabulary studi 3a, but these studies have 
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paid very little attention to the grammatical functions of words. One 
can find instances of words that are assigned high frequencies in word- 
lists but that can appear in very unusual meanings and grammatical 
functions. A good example is the word are , which is one of the most 
frequent words in the English language. It nearly always appears es one 
of the forms of the verb to be, but it has a homonym, are , that refers to 
a unit in the metric system. In this meaning are is a no ion, but of course 
the frequency with which the word occurs in this meaning is very low. We 
would expect a child to have difficulty in comprehension if he meets the 
word are in its noun function. The word "are" is an extreme case, but if 
we consider the many grammatically ambiguous words of more moderate 
frequency, it becomes obvious that frequency lists may be very misleading 
when they do not take grammatical function into account. Teachers and 
others ''oncerned with preparing instructional material need information on 
the relative frequencies of different manifestations of lexical items. 

They also need information on the extent to which difficulties in 
comprehending language are due to failures in understanding the grammatical 
functions of words; if such difficulties are indeed found to be associated 
with failures in understanding grammatical functions, it may be desirable 
to develop special materials to help pupils learn a generalized skill of 
interpreting words in uncommon grammatical functions. This research has 
sought to provide such information. 

On the theoretical side, this research was motivated by the idea 
that a study of the ways in which children perceive the grammatical functions 
of words would contribute towards better understanding of funlamental 
processes of the learning and comprehension of language. One important 
aspect of the understanding of language is the assignment of grammatical 
structure to sentences that are heard or reaij- "Understanding” a sentence 
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like Time flies like an arrow involves deciding tlat its grammatical structure 
(at least at a surface level) is 

Time flies like an arrow 

(Noun) (Verb) (Prepositional phrase) 

rather than seme other possible interpretation. The individual's ability 

to interpret such sentences depends in part upon his knowledge of the 

grammatical information contained In lexical items. We know litule, 

however, about the development of such grammatical information in the 

individual. 

This is, in fact, a matter of current interest in linguistic and 
psychological theory. Katz and Postal (1964) postulate that users of a 
language acquire knowledge of the "dictionary entries" of the lexical 
items both in terms of syntactic markers and semantic markers. The 
syntactic markers would involve information as to what part or parts of 
speech the word can be used. There has been controversy over whether 
the dictionary entries involve only sctne "base form" of the item in a 
given part of speech, with transformational rules postulated to take care 
of derivations to other parts of speech (the "transformationalist hypothesis"), 
or ; on the contrary, involve simultaneously all the parts of speech in 
which an item appears ( Ihe "lexicali.it" hypothesis). Whitaker (1970) presents 
evidence from studies with aphasics that he claims supports the lexicalist 
hypothesis . 

In effect, this study is an investigation of one aspect of what may be 
called "parsing behavior," i.e., the individual's assignment of grammatical 
classifications to lexical items. Parsing is a word that traditionally 
means "assigning parts of speech"; it usually denotes the explicit verbal 
classification of words in sentences, i.e., calling them nouns, verbs, etc., 

Q * indicating the relationships of the words in a sentence by showing 

j ^ s e structure, immediate constituents, etc. In our usage of the word here 

12 
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however , we refer to the Implicit perception of words as having certain 
grammatical properties, even if this perception takes place completely 
out of awareness. 

Ordinarily, grammatical functions of words are cued by the total 
linguistic and nonlinguistic contexts in which they appear. The context 
is often minimal, but not always so. Examples of minima] linguistic 
contexts for "parsing" the word alert as noun, verb, or adjective are the 
following: "An alert!" "Alert him!" and "Be alert!" 

Nevertheless, for analytical purposes it is useful to study the 
language user's perceptions of the grammatical functions of lexical items 
in isolation. It is possible that such perceptions play some fundamental 
role in understanding and parsing words even when they are in context, 
and that the effect of context in normal language messages is to modulate 
in some special way the "parsing" that occurs when the word is presented 
in isolation. If so, it would be desirable to study under what conditions 
this modulation takes place, and there would be a need for "baseline” 
studies of grammatical perceptions of words in isolation. The present study 
is designed to obtain such baseline information for a fairly representative 
sample of grammatically ambiguous words, at several school gre.de levels. 

There is a long history of attempts to study individuals' responses to 
words in isolation. Rowland (1907) presented words in isolation in different 
parts of speech and asked her one 3 ubject to introspect on "how her state 
of mind varied as she passed from the meaning of one word to the next," 
e.g., as she passed through the series entrance , enter in, inner , or the 
series weight, lift , heavy , under . Pjych jlogistr have expended much effort 
in obtaining 1 free associations" to words in isolation, but they have paid 
little attention to the parts of speech in which either the stimulus words 
or the response words appeared (Cramer, 1968),.^ It has been noted, however, 
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that adults are more likely than children to respond with a word in the same 
part of speech as the stimulus word, a fact that may possibly indicate that 
adults are more aware of the tart- of- speech classifications of the stimulus 
word3. There has been little investigation of responses to stimulus words 
that are ambiguous with respect to part-of -speech. In two recent 
investigations of responses to homographic or homonymic words (Cramer, 1970; 
Galbraith and Taschman, 19^9) no consideration was given to the grammatical 
classifications of the stimuli or the responses. 

The present study will not use the free association technique, but 
rather a technique whereby the subject is asked to use a given word in a 
sentence. There is, of course, ample precedent for such a procedure in 
the common school practice of teachers. In psycholinguistic studies, it 
has been used quite frequently, e.g., by Ervin (1963)* Fa ibish (1961)1 and 
Taylor (1969)* The presumption is that the grammatical part of speech In 
which the word is used in a sentence will tend to indicate its "predominant" 
part of speech. Hoeenzweig and McNeill (19 62) noted that when a word is 
presented in isolation it is usually taken in the sense of its predominant 
meaning; it is reasonable to assume that it would also be usually taken 
in its "predominant" grammatical function. 

The study was also designed to yield information that might have a 
bearing on the possibility that certain grammatical functions for a lexical 
item may be more basic to the description of that item than other grammatical 
functions that could be regarded as derived frcm tl^e basic function. For 
example, "alert" is perhaps basically an adjective describing a certain 
state; in several dictionaries, at least, it is listed first as an adjective. 
The verb "alert" may be derived from this by a semantic transformation that 
means "cause to oe X," and the noun "alert" is perhaps still a further 

.tion by a transformation that me^ne "an occasion when one is caused 
X.' Information on the grammatical functions of isolated words could 
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be helpful in developing end evaluating theories having to do with such 
relations, although the assumption that the moot frequent parsing of a word 
presented in isolation corresponds to the word’s ''basic” grammatical 
function would need careful examination. 

Finally, the study was designed with the thought that psycholinguistie 
research, as well as various kinds of research in verbal learning, could 
profit from the availability of lists of grammatically ambiguous and 
unambiguous words with appended information on the parsings in which they 
are most frequently perceived. Researchers in these fields have often had 
need for such information (see, for example, Hall and Crcwn, 1970; Shapiro 
and Fhlermo, 1967 ; Taylor, 1969)* 

In summary, the problems investigated in this study were as follows; 

(1) Kow frequently is it the case that words in English have multiple 
grammatical functions? What are some of these words, and what are some 

of the words that are unambiguous grammatically? In what grammatical 
functions are grammatically ambiguous words perceived most frequently when 
presented in icolation? To what extent is grammatical ambiguity associated 
with polysemy? 

(2) To what extent does the school-age child have difficulty in 
understanding language because he does not know the meanings of words when 
they appear in their less frequent grammatical usages, or because he has 
not learned to interpret them in such usages? If so, is this because he 

is generally unaware that words may have the property of multiple grammatical 
uses, or is it simply because he has not experienced the unusual uses with 
sufficient frequency? 

(3) What developmental trends are there in the ability to interpret 
Q he less frequent grammatical usages of words? How does this ability 
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(4) What Implications for linguistic and psycholinguistic theories 
can be drawn from the findings? 

Hypotheses 

(1) Words having multiple grammatical functions are quite frequent 
in the English language, both in terms of types and tokens, Multiple 
grammatical functions vill occur somewhat more frequently among high- 
frequency than low-frequency words, but even low-frequency words will often 
exhibit multiple grammatical functions. 

(2) School-age children will have more difficulty in understanding 
sencences in which certain words are used in relatively less frequent 
grammatical functions, than sentences In which these words appear in more 
frequent gramme tical functions. 

(3) There will be age-developmertal trends in the ability to understand 
sentences containing words used in less frequent grammatical functions; 
these trends will also be correlated with general verbal ability as 
measured by a vocabulary test. 

Related literature 

The problems set forth above seem never to have been directly studied. 
Petty, Keroid, and Stoll (1968) point out that investigations in the field 
of vocabulary teaching have paid little or no attention to grammatical 
factors. There are some studies (e.g,, HurllurL, 195*0 that have investigated 
the relative difficulty of different parts of speech, but no studies have 
been found that have been concerned with the relative difficulty of different 
grammatical usages of single lexical items. Many investigations have had 
to do with children's knowledge of the multiple meanings of homophonous or 
hotnographic voids (Berwick, 1952; Howards, 1964; Lovell, 1941; Russell, 1954; 




Thevaos, 1951) but these touch only indirectly 
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on the problems of multiple grammatical functions. Detailed studies of 
children T s difficulties in interpreting textual materials (e.g., Jenkinson, 
1957) suggest that some of these difficulties may be due to children's 
inability to interpret *>rords in unusual grammatical functions. This 
suggestion is also borne out by the common expe'"ienc^ of classroom teachers. 

On the other hand, there is some reason to think that when a given 
vord carries the same basic semantic content in its various grammatical 
usages, children may have little difficulty in interpreting it in its 
various usages. Brown (1957) shoved that even pre-school children have 
little difficulty in using grammatical context to determine part- of- speech 
class of a novel (nonsense) vord; one might think, therefore, that school- 
age children would have little difficulty in interpreting novel grammatical 
functions of familiar words. An observation made by two investigators of 
child language acquisition may be relevant at this point: 

T1 Richard's performance with parts of speech is also revealing. At 
first, he seemed to classify words into parts, of speech in strict adherence 
to adults’ models. For instance, of the 30 stems in our records which 
occurred with -ing at the age of 26-27 months, all are verbs in adult 
English. By 30 months, however, Richard began to use words in other parts- 
of- speech than he heard them. The best examples, as usual, are those in 
which differences from adult English make the process clear. At 30 months, 
he said somethirg about an airplane which was •loud, 1 then spoke the phrase 
r a louding plane. f At 30 months he protested a vigorous scrubbing by 
saying, 'Don't wash that poor little sore, because it r s still soring.' At 
33 months he announced playfully, ' J’ll stomach you,' and pushed his mother 
in the stomach’ 1 (Carlson and Anisfeld, 1969, p. 573). 

Brown (1957) observed that in very early language acquisition, the 
louns children learn are in most cases names of concrete things, and the 



- 10 - 



verbs are mostly names for observable actions. The implicit meaning of the 
form-class noun for the young child is therefore apparently "concrete 
object" while the implicit meaning of the verb fona-class is "action." 

Up to the age of 26-27 months, the child observed by Carlson and Anisfeld 
must have been adhering to these form-class meanings, but later, the form- 
class allegiances of words started to spread over several categories. 

Carlson and Anisfeld r 8 observations suggest that one of the problems faced 
by the young child at a certain stage is to learn what restrictions adult 
language imposes on lexical items: for example, that adult language requires 
that loud be usee as an adjective. By the time the child reaches school 
age it may be the case that he is still learning these restrictions, and 
it is even possible that his learning of the grammatical functions most 
frequently associated with certain lexical items goes so far as to 
prevent him from recognizing and properly interpreting unusual grammatical 
functions for those items. For example, the 3rd-gnide child may no longer 
be able to appreciate the use of "louding" in "a louding plane." Likewise, 
he might not be able to interpret properly the use of a word like FREE as 
a verb after having learned that it is normally used as an adjective. 

Thus, it may be said that the previous literature on the question 
of children* 8 interpretations of words in unusual grammatical functions is 
almost nonexistent, and that what little literature there is is highly 
inconclusive. 
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Identification of MGF Words 



Introduction 

Before the central problems of this investigation could be attacked, 
it was necessary to develop lists of words that have multiple grammatical 
functions (MGF words). For certain purposes, it was also desirable to 
develop lists of words that are unambiguous as to grammatical function (UGF 
words). For the MGF words it was necessary to obtain data that would tell 
what the more frequent and less frequent grammatical functions are. This 
chapter reports how these lists were developed and what kinds of information 
vere obtained for the MGF and UGF words that were identified. 

Obtaining samples of MGF and UGF words 

As far as this investigator was aware, no lists of MGF and UGF words 
were available in the literature of vocabulary studies, lexicography, or even 
computational linguistics. It was therefore necessary to develop lists 
for the special use of this project. 

We could, of course, have developed lists by examining all the words 
in given frequency ranges of certain word-lists such as the Thcrndike-Lorge 
frequency count (Thorndike and Lorge, 19 ^ 4 ) or the recent Brown University 
count (Kucera and Francis, 1967), using dictionary information on the 
occurrence of various grammatical functions. The plan of the investigation 
called for the use of MGF and UGF words that would be appropriate over a 
fairly wide range of school grades — from grade 3 to grade 9 » It was judged 
that the words to be used should range over the first ten thousand in frequency 
in Thorndike's (1932) earlier compilation. Examining ten thousand words for 
multiple grammatical functions would have been too large a task to accomplish 
within the time period planned for the investigation (in view of the other 
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tasks that had to be performed). It was decided, however, to examine a 5 % 
random sample of the first ten thousand words in frequency according to 
Thorndike's (1932) list. This earlier, 1932, list was used instead of the 
later, 1944, compilation that is better known, because unlike the latter it 
gives a rank- index, by thousands, for each word. Thus, a word listed with the 
rank-index n 7" is one that appeared somewhere in ranks 6001-7000 in frequency 
in Thorndike's corpus. Rank-indices from 1 to 5 also are suffixed by the 
letters "a" or "b T1 to provide a further differentiation into groups of 500 ; 
thus, a word listed as having a rank-index of 3a was one that appeared among 
ranks 2001-2500 in Thorndike's compilation. 

By random selection procedures, 50 words were chosen from each group 
of 1000 voras by frequency in the Thorndike list. The procedures insured 
also that for the first 5 000 words, 25 words would be chosen from each group 
of 500 words. There was, however, one constraint upon the random selection 
process: no proper names or otherwise capitalized words were chosen. 

Wherever such a word woula have been chosen by the selection process, it was 
replaced with a noncapitalized word having the same rank-index. The list 
cf 500 words so chosen is included in the tabulation in Appendix A. The 
list includes, of course, all varieties of words — nouns, verbs, adjectives, 
prepositions, etc., although the prime interest of this investigation was 
centered on grammatical ambiguities of words across the categories noun, 
verb, and adjective. 

The writer and several research assistants then went through the list 
of 500 ’'ords to make an initial judgment as to their grammatical functions. 

For each word, a series of numbers was assigned (hereafter called an "MGF 
vector' 1 ) to indicate the parts in ten ( perdecems ) into which the incidences 
*he word in four grammatical class if ications were Judged to fall: noun . 
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verb, adjective , and other , respectively. Thus, the word IAST was assigned 
the MGF vector 1, 2, 6, 1 , meaning that the word was judged to occur as 
a noun about 10$ of the time, a verb about 20$ of the time, an adjective 
about 60$ of the time, and "other" (adverb) about 10$ of the time. Sometimes 
the numeral 1 was prefixed by a minus s5gn to indicate that the word was 
used very rarely in a particular grammatical function; for example, the 
word TAKE was assigned the MGF vector -1, 9 , 0, 0 because it was thought to 
occur only very rarely as a noun. 

A number of sources were used as guides in assigning the MGF vectors. 

Many of the words were looked up in the Oxford English Dictionary to find 
authority for various grammatical usages. The most helpful source was Lorge 
and Thorndike's (1938) semantic count, which gives frequencies (based 
on a corpus of about 4,500,000 tokens) for each meaning and grammatical 
function of a word, keyed to the entries in the Oxford English Dictionary . 
Another helpful source was West's (1953) General Service List of English Words , 
which gives information on grammatical and semantic frequencies of about 2000 
w f ords. West's frequencies (expressed in percentages) are mainly derived 
from Lorge and Thorndike's data, however, and are sometimes modified to 
reflect British (as opposed to American) usage. Nevertheless, in a number 
of instances the information in West served to complete what was missing from 
the Lorge and Thorndike semantic count. In the case of many words, however, 
neither Lorge -Thorndike nor West gave any useful information, arid it was 
necessary to rely on the coder's native language intuitions. Generally, 
the two or three people who assigned the MGF vectors were able to arrive 
at a reasonable consensus. The MGF vectors assigned at this stage were 
regarded as only provisional, in any case; they were needed only in order to 
develop lists of UGF and MGF words for use in later studies that would, 




presumably, yield objective information concerning children's parsitigs of the 
words when presented in isolation. 
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Actually, it should be noted that the MG F vectors were continually revised 
during the cours e of the project. It was somewhat humbling to find that 
in the original assignment of the vectors certain fairly frequent usages of 
the words had & imply been overlooked. For example „ in the original coding, 
the word OFFENSIVE had been regarded as an unambiguous adjective (MGF 
vector 0, 0, 10, 0 ); the noun use had not been noted. It became evident that 
a word presented in isolation often exerts such a powerful stimulus -value 
in a certain direction that one fails to perceive another possible stimulus- 
value even though it might be one encountered fairly frequently in certain contexts. 

There were certain other problems in the assignment of the MGF vectors. 

We were deeding only with the ''entry” forms of the words — not (in general) 
with their plurals, possessives, past tenses, participles, or gerunds. It 
happened, however, that two of the words resulting from the sampling procedure 
were clearly not base forms even though they were entries in the Thorndike 
compilation: SENT and TOOK. For the purposes of the tabulation, these were 

changed to SEND and TAKE, respectively. A serious probie n was the assessment 
of words that are normally nouns, like CITY, that car be used also as attributive 
adjectives, as in ”a city block.” Generally, such vcris were not counted as 
adjectives unless they could, in the adjective usage, denote a distinct 
quality, e.g., CHOCOLATE. Reference was made to several dictionaries in 
deciding cases like these, although it should be said that dictionaries do 
not seem to follow consistent rules for handling such oases. 

After the words had been assigned MGF vectors, they were sorted into the 
following classes: 

(1) Unambiguous nouns (N) 

(2) Unambiguous verbs (V> 

( 3 ) Unambiguous adjectives (A) 

9 (4) Ambiguous, either noun or verb (but not adjective) (NY) 

ERIC 
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( 5 ) Ambiguous, either noun or adjective (but not verb) (NA) 

(6) Ambiguous, either verb or adjective (but not noun) (VA) 

(7) Ambiguous, either noun, verb, or adjective (NVA) 

(8) Ambiguous, some combination of noun, verb, and/or adjective with 

another part of speech (N, V, A, 0) 

(9) Unambiguous "other" part of speech: preposition, conjunction, et:. 
It was of interest to take these 500 words from the Thorndike list and 

tabulate them by frequency rank-index and the above grammatical classifications. 
The results of this tabulation are shown in Table 2,1, Several conclusions 
emerge from an inspection of this table: 

(1) Grammatically ambiguous words are somewhat more likely to be found 
among words that are listed as being of high frequency. To some extent, this 
may be due to the well-known fact that words of high frequency are more 
likely to have multiple meanings, 

(2) Grammatically unambiguous nouns increase in incidence as the frequency 
decreases (or as the rank- index increases), but the proportions of unambiguous 
verbs and adjectives remain fairly constant over the ten frequency groups, 

( 3 ) The most frequent class of ambiguous words is Noun-Verb (NV) 
words. The next most frequent is the Noun-Ad jective class (NA), and there 
are relatively few words in the remaining ambiguous classes, 

(4) About Kjjo of all the words sampled are grammatically ambiguous in 

the sense defined here. Presumably, this is a good estimate of the proportion 
of words in the first ten thousand of Thorndike's list that are grammatically 
ambiguous. It should be noted that this figure is based on types , not tokens. 

No estimate was made as to what the figure; would be if it were based on tokens. 
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Selection of a further ssn p ie 

Inspecting the words contained in the Thorndike sample, we became convinced 
that this sample did not include a sufficient, number of UGF and MGF words 
of relatively high frequency and familiarity to serve the purposes of the 
further studies that were planned. Marty words in the fifth Thorndike 
thousand ere judged to be somewhat difficult for 6th graders; a few were 
judged difficult even for 9th graders. It was decided that a large sample 
of words of relatively high frequency would be needed in order to select 
appropriate UGF and MGF words for subsequent phases of this investigation. 

This larger sample could, of course, have been obtained by further sampling 
from the Thorndike list. It was not obtained in this way because the writer 
learned of what seemed to be a better and more convenient source. 

This source was a so-called Harvard Dictionary compiled by Philip Stone 
(personal communication; see Kelly, 1970) and his associates in the course 
of developing the General Inquirer procedure for content analysis (Stone, 

Dunphy, Smith, and Ogilvie, 1966). It consists of a list of 1178 words that 
occurred with frequencies of 10 or greater (i.e., p> .000023, log p > -4.634) 
in a corpus of 430,397 words collected from 56 different sources from nine 
basic areas (conversational material, personal documents, dream reports, 
survey replies, TAT stories, literature, speeches, editorials, and folktales). 
Most of these words, then, could be regarded as being in adults* active 
vocabularies. The particular virtue of the list, however, was tnat (at least 
in the computer tape that was obtained from Dr. Stone) the frequencies of the 
several meanings and usages of the words, ac coded by hand, were reported. 

From such information it became possible to estimate MGF vectors rather more 
accurately, we thought, than from tne data in the Lorge Semantic Count or in 
West’s General Service List , both of which were somewhat obsolete. The 
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Harvard Dictionary list, however, did not “parse" words into different grammatical 
functions unless their meanings deserved separate entries. 

A research assistant worked through the complete Harvard Dictionary 
list to identify all words that could normally be used as nouns, verbs, 
or adjectives, whether or not they were ambiguous in grammatical function. 

This yielded a list of 768 such words ( 65 . 2$ of the total list). These 
words were then classified as to grammatical ambiguity in the same manner as 
was the case for the Thorndike sample. An analysis of these words according 
to the Thorndike frequency rank-indices is shown in Table 2.2. It may be 
noted that the percentages of grammatically ambiguous and unambiguous words 
for the Harvard Dictionary sample follow the same general trends as for the 
Thorndike .ample; the percentages, however, are not exactly comparable because 
the Harvard Dictionary sample excluded words that were rot normally nouns, 
verbs, or adjectives. 

It was found that 48 words occurred on both the Thorndike and the 
Harvard Dictionary lists. The combined list, analyzed in Table 2.3 according to 
the Thorndike rank -frequency indices and grammatical ambiguity classification, 
comprised 1220 words. It included 615 words that had been judged cc be 
grammatically ambiguous, and since many of these were high-frequency words 
it was thought to provide an adequate sample of words that courd be used in 
later phases of this investigation. The numbers of words available; in 
certain grammatical ambiguity classifications, however, were still rather small. 

It appears that there are very few words in English whose entry fonns 
car. be used as either verbs or adjectives, for example. 
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Dale class if ioation s 

Various other kinds of information were developed for the final list 
of 1220 words , but only after the studies reported in Chapters III, IV, 
and V were already in progress. These types of information, therefore, 
could be used only *n helping to interpret the results of those studies. 

One type of information was represented by what were called "Dale 
ratings,” Dale (1948) compiled a list of approximately 3000 words that he 
found to be known in reading by at least 80$ of children in grade 4. 

Such words were assigned a Dale rating of "1." Later, Dale and Eichholz 
(undated) published an interim report on children's knowledge of words at 
grades 4, 6, 8, 10, and 12. Their lists were developed on the basis of 
vocabulary tests that were given to representative samples of children at 
Lhese grade levels. "Dale ratings" of 2, 3> 4, 5; and 6 were assigned on 
the basis of the grade placement of the words, according to the key given 
below. However, it was found that many words appeared on several grade-lists, 
often because different meanings of the words were tested at the different 
grade levels. For our purposes, the ratings were assigned according to the 
grade level at which the word first appeared in any meaning and was known 
by 67$ or better at that level. Some words were not found on any of Dale’s 
lists, or if they were found, were known by fewer than 2/3 of the children 
in grade 12. The key for the "Dale ratings" is therefore as follows; 

1 : The word occurs on Dale’s (1948) list of approximately 3000 words 

known in reading by at least 80$ of children in grade 4. 

2 ; At least one meaning of the word is known by at least 2/3 of children 

in grade 4, according to Dale and Eichholz (undated). 

3 : At least one meaning of the word is known by at least 2/3 of children 

it grade 6. 




29 



- 22 - 



4 : At least one meaning of the word is known by at least 2/3 of children 

in grade 8. 

5 i At least one meaning of the word is known by at least 2/3 of children 

in grade 10. 

6 ; At least one meaning of the word is known by at least 2/3 of children 

in grade 12. 

7 : The word does not appear on any of Dale's lists, or there is no 

meaning for the word that is known by as many as 2/3 of children in 
grade 12. 

Table 2.4 presents a cross-classif ication of the words in the final 
sample by Thorndike frequency-rank index and Dale classification. The relation 
between Thorndike frequency-rank indices and Dale ratings is only moderate. 

Coding of MGF words for polysemy ("semantic code 11 ) 

It was anticipated that children's parsings of MGF words might be 
related to the degree of polysemy (multiple meaning) of these words. Therefore, 
the following codes were assigned: 

0 : This code was assigned to all UGF words since there was no interest in 

this study in the possible polysemy of these words, 

1 : This code was assigned to MGF words which were regarded as having 

fundamentally the same (one) meaning in the two or more parts of 
speech. Examples; AGE (NV), CHANCE (NVA), FILL (NV), FREE (NV), 
GRADUATE (NVA), HIRE (NV), SORROW (NV), TAKE (NV; . 

2 ; Assigned to MGF words having two or more basic senses, each of which 

participates in the respective grammatical manifestations. 

Examples; PAGE (NV), TYPE (NV). 

3 : Assigned to MGF words with multiple senses that are differentially 
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Table 2.4 



Cross-Classification of Words in the Final Sample by 
Thorndike Frequency-Rank Index and Dale Rating 

Dale Rating 



mornaiKe 
Frequency- 
Rank Index 


1 


2 


3 


4 


5 


6 


7 


Total 


i 


396 


6 


14 


4 


0 


0 


1 


421 


2 


137 


15 


58 


15 


2 


2 


4 


233 


3 


42 


11 


43 


11 


1 


0 


1 


109 


4 


24 


11 


32 


17 


5 


1 


0 


90 


5 


11 


11 


33 


12 


3 


3 


5 


78 


6 


9 


3 


26 


7 


4 


2 


7 


58 


7 


5 


7 


18 


14 


ll 


2 


7 


64 


8 


3 


5 


17 


16 


ll 


1 


.8 


6l 


9 


4 


3 


12 


8 


6 


3 


18 


54 


10 


1 


3 


11 


4 


10 


9 


13 


51 


n-i8 


1 


0 


2 


0 


1 


3 


3 


10 


Total 


633 


75 


266 


108 


54 


26 


67 


1229* 


*This 


number 


includes 


nine further words 


derived 


from words 


in the basic 


sample 
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dietributed among grammatical parts of speech. For example, 

PLANE (NVA) has the meaning "flat, level' 1 as a noun, verb, and 
adjective, and the meaning "tool for smoothing" as a noun or a verb. 
Other examples: CARDINAL, GAMS, INCENSE, KNOT, LINE, PLANK, 

PRIMARY, SEASON, SWAMP . 

h : Assigned to MGF words in which the different senses occur exclusively 

in different parts of speech. For example, GRAVE (NA) has the 
meaning "burial place" as a noun, but the meaning "serious" as an 
adjective. Other examples: NOVEL, PRIVATE, SKIRT, TARRY, UNIFORM. 

It was often difficult to decide upon this semantic coding. For purposes 
of analysis, it is probable that codes 2, 3> and 4 should be grouped. 

The Dale ratings and semantic codes assigned to the words in the final 
sample will be found in the tabulation in Appendix A. They will also be 
found in various tables discussed in Chapters III, TV, and V. 
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Chapter III 

A Pilot Experiment on a Possible Priming Effect in the Grammatical 
Perception of Words Presented in Isolation 




Introduction 

The basic plan of the first phase of this study called for obtaining 
information on the grammatical functions that children perceive in 
grammatically ambiguous words presented in isolation. The technique to 
be employed was that of asking children to use a given word in one or more 
sentences, It seemed reasonable to assume that the part of speech in which 
a word is most "naturally" perceived when presented in isolation would be 
reflected in the part of speech in which it is used in the first sentence 
written by a respondent when he is asked to write one or more sentences 
illustrating the use or uses of the word. It was believed further that by 
inspection of the sentences written by the respondent, it would in 
most cases be possible to determine in what part of speech the word 
was in fact used. Data on the relative frequency with which samples of 
children at several grade levels used a word in various parts of speech 
would presumably yield norms for use in later phases of the study. 

There was, however, a prior question to be answered before further 
studies could be made. If a respondent were given a series of isolated 
words, would the part of speech in which he used a given word be influenced 
by the part of speech he used for a preceding word? That is, would his 
part-of-speech use for word 1 create some sort of set that would partly 
determine his part-of-speech use for word (i_ + i) ? If so, the collection 
of data on any large number of words presented sequentially would require 
control of the order in which the words were given, possibly by some 
procedure of counterbalancing or randomization. There is some evidence in 
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the free association literature (Cramer, 1968, Chapter 2) that the type of 
association given to a certain word is influenced by the nature of the words 
immediately preceding the word in a list. For example, Wynne, Gerjuoy, and 
Schiffman ( 1965 ) reported that the presentation of stimulus words likely to 
elicit antonyn responses could induce sets that influenced the responses given 
to succeeding words in the list. A similar "priming" effect might occur in 
connection with the parsing behavior being studied here. 

In order to answer this question, as well as to explore the technique of 
data collection that was proposed, a pilot experiment was conducted in which 
the presentation of each grammatically ambiguous (MGF) word was preceded by 
the presentation of a grammatically unambiguous (UGF) word that would almost 
surely be perceived in a designated part of speech — a noun, a verb, or an 
adjective. Thus, if there were any priming effect, the part of speech in which 
the MGF word was used would tend to vary according to whether it was preceded 
by a grammatically unambiguous noun, verb, or adjective. 

Method 

From the compilations of grammatically ambiguous words described in 
Chapter II, four sets of 9 words eacn were selected, a total of 36 words. 

The plan called for selecting the first set from Thorndike (1932) frequency- 
rank categories 1 and 2, the second set from categories 3 and 4, the third set 
from categories 5 and 6, and the fourth set from categories 7 and 8* However, 
several minor deviations from this plan had to be permitted in order to select 
a sufficient number Of words for each set in view of the further constraints 
that were placed upon the selection, Kaeh set was to contain 3 NV words, 

3 NA words, aid 3 VA words. Furthermore, each set was to contain one with a 
high MGF rati ig for the first part of speech and a low rating for the second 

o 

ERIC of speech, a second with the opposite of this condition, and a third with 
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approximately equal MGF ratings for the two parts of speech. For example, the 
three MV (noun-verb) words selected at Level I (Thorndike indices of 1 or 2) 
were BLOSSOM (MGF vector 820), JUMP (MGF vector 2 8 0), and GLAMCE (MGF 
vector 640). The purpose was to see whether the priming effect, if any, 
would be stronger when the MGF ratings were approximately equal. 

For each set of nine MGF words, nine UGF words were identified in the 
compilations with Thorndike indices approximately matched with those of the 
MGF words; of these, three were nouns, three were verbs, and three were 
adjectives , 

Three alternate test forms were then constructed for each of the four 
levels (a total of 12 forms) by assigning the UGF words to odd-numbered 
positions and the MGF words to even-numbered positions. The MGF words were 
the same and had constant positions in the three forms for a gi/en level. The 
UGF words, however, were distributed among the three forms in different random 
orders in such a way that for a given form, there were 3 N words, 3 V words, 
and 3 A words in the odd-numbered positions, and also such that across the three 
forms, each MGF word was preceded by a noun in one form, a verb in a second 
form, and an adjective in a third form. Table 3*1 gives the complete structure 
of the 12 forms, with the MGF vectors and Thorndike frequency-rank indices 
indicated for each word used. 

Fach test form had a cover page givirg instructions; the same cover page 
was used for all 12 forms. (A sample form is shown in Appendix B). The 
instructions read as follows: 

"We want to find out how yo' and others in your grade use certain words." 

"Look at each word and make up a short, complete sentence that shows how 
you might use it. Write the first sentence that you think of." 

’Then, if you can think of other ways to use the word, write one or cwo 
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Table 3.1 

KGF and UGF Words Used in the First Pilot Experiment, with 
Grammatical Claesif ication, MGF Vector, and Thorndike Frequency-Bank Index 



Level I 



UGF Word (Odd-Numbered Items) 



Item 

No. 


Form A 




Form B 




Form C 




MGF Word 

(Even-Numbered Item 
All Forms) 


1,2 


COUNTRY 
(N, 10 0 0, 


la) 


REAL 

(A, 0 0 10, 


lb) 


SEND 

(V, 0 10 0, 


la) 


SAVAGE 
(NA, 4 0 6, 


2b) 


3,4 


SEND 

(V, 0 10 0, 


la) 


HONEST 
(A, 0 0 10, 


2a) 


COUSIN 
(N, 10 0 0, 


2a) 


LIVE 

(VA, 091, 


la) 


5,6 


COUSIN 
(N, 10 0 0, 


?a) 


SEND 

(V, 0 10 0, 


la) 


AERAID 
(A, 0 0 10, 


lb) 


BLOSSOM 
(NV, 820, 


2 a) 


7 ,C 


REAL 

(A, 0 0 10, 


lb) 


COUSIN 
(N, 10 0 0, 


2a) 


EXPLAIN 
(V, 0 10 0, 


2a) 


GENERAL 
(NA, 109, 


la) 


9,10 


ENTER 

(V, 0 10 0, 


lb) 


AERAID 
(A, 0 0 10, 


lb) 


COUNTRY 
(N, 10 0 0, 


la) 


FREE 

(VA, 0 19, 


la) 


11,12 


EXFLAIN 
(V, 0 10 0, 


2a) 


COUNTRY 
(N, 10 0 0, 


la) 


HONEST 
(A, 0 0 10, 


2a) 


GLANCE 
(NV, 640, 


2 b) 


13,14 


HONEST 
(A, 0 0 10, 


2a) 


PRINCE 
(N, 10 0 0, 


lb) 


ENTER 

(v, 0 10 0, 


lb) 


INSTANT 
(NA, 901, 


2 b) 


15,16 


AERAID 
(A, 0 0 10, 


lb) 


ENTER 

(V, 0 10 0, 


lb) 


PRINCE 
(N, 10 0 0, 


lb) 


DIRECT 
(VA, o 6 4, 


lb) 


17,18 


FRINCE 
(N, 10 0 0, 


lb) 


EXPLAIN 
(V, 0 10 0, 


2a) 


REAL 

(A, 0 0 10, 


lb) 


JUMP 

(NV, 280, 


2 a) 
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Table 3*1 (continued) 
Level II 



UGF Word (Odd-Numbered Items) 



Item 

No. 


Form A 


Form B 




Form C 


MGF Word 

(Even-Numbered Items, 
All Forms) 


1,2 


CAMEL 

(N, 10 0 0. 4b) 


DESPERATE 
(A, 0 0 10, 


4a) 


ARISE 

(V, 0 10 0, 3a) 


ELDER 

(NA, 2 0 8, 


3b) 


3,4 


ARISE 

(V, 0 10 0, 3a) 


PERSONAL 
(NA, -10 9 


, 3*r 


OVEN 

(N, 10 0 0, 3b) 


SPARE 

(VA, 082, 


2a) 


5,6 


OVEN 

(N, 10 0 0, 3b) 


ARISE 

(V, 0 1C 0, 


3a) 


RAINY 

(A, 0 0 10, 4a) 


SCREEN 
(NV, 910, 


4a) 


7,8 


DESPERATE 

(A, 0 0 10, 4a) 


OVEN 

(N, 10 0 0, 


3b) 


SOFTEN 

(V, 0 10 0, 4b) 


MORAL 

(NA, 109, 


3a) 


9,10 


ORGANIZE 

(V, 0 10 0, 4b) 


RAINY 

( A, 0 0 10, 


4a) 


CAMEL 

(N, 10 0 0, 4b) 


LAST 

(NVA, 127, 


, la) 


11,12 


SOFTEN 

(V, 0 10 0, 4b) 


CAMEL 

(N, 10 0 0, 


4b) 


PERSONAL 

(NA, -10 9, 3b}* 


WAX 

(NV, 460, 


3a) 


13,14 


PERSONAL 
(NA, -1 0 9, 3W 


LANTERN 
(N, 10 0 0, 


4b) 


ORGANIZE 
(V, 0 10 0, 4b) 


INDIVIDUAL 
(NA, 7 0 3, 


3a) 


15,16 


RAINY 

(A, 0 0 10, ha) 


ORGANIZE 
(V, 0 10 0, 


4b) 


LANTERN 

(N, 10 0 0, 4b) 


MATURE 
(v'A, 0 5 5, 


4a) 


17,18 


LANTERN 

(N, 10 0 0, 4b) 


SOFTEN 
(V, 0 10 0, 


4b) 


DESPERATE 
(A, 0 0 10, 4a) 


DIP 

(NV, 2 8 0, 


3a) 



* x In an early compilation of the MGF words, PERSONAL had been regarded as an 
unambiguous adjective; after this pilot study was done, it was realized 
that it could also be regarded as a noun (meaning "a personal item as in a 
newspaper’') , though with low frequency. 
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T&ble j.i (continued) 
Level III 



Item 

No. 




UGF Word (Odd-Numbered Items) 


MGF Word 

(Even- Numbered Items, 
All Forms) 


Form A 


Form B 


Form C 


1,2 


RAINFALL 


ABSURD 


DISTRIBUTE 


OFFICIAL 








(N, 10 0 0, 6) 


(A, 0 0 10, 6) 


(V, 0 10 0, 5a) 


(NA, 5 0 


5, 


3a) 


3,4 


DISTRIBUTE 


LONESOME 


ORCHESTRA 


ANIMATE 








(V, 0 10 0, 5a) 


(A, 0 0 10, 5a) 


(N, 10 0 0, 5t>) 


(VA, 0 9 


1, 


6) 


5,6 


ORCHESTRA 


DISTRIBUTE 


UNDISTURBED 


CHART 








(N, 10 0 0, 5b) 


(V, 0 10 0, 5a) 


(A, 0 0 10, 6) 


(NV, 9 1 


o, 


5b) 


7,8 


ABSURD 


ORCHESTRA 


RENOUNCE 


PRIMARY 








(A, 0 0 10, 6) 


(N, 10 0 0, 5b) 


(V, 0 10 0, 5a) 


(NA, 1 0 


9, 


5b) 


9,10 


WEAKEN 


UNDISTURBED 


RAINFALL 


DIZZY 








(V, 0 10 0, 6) 


(A, 0 0 10, 6) 


(N, 10 0 0, 6) 


(VA, 0 1 


9, 


6) 


11,12 


RENOUNCE 


RAINFALL 


LONESOME 


CHISEL 








(V, 0 10 0, 5a) 


(N, 10 0 0, 6) 


(A, 0 0 10, 5a) 


(NV, 4 6 


0, 


6) 


13,14 


LONESOME 


COMPETITION 


WEAKEN 


CARDINAL 








(A, 0 0 10, 5a) 


(N, 10 0 0, 6) 


(V, 0 10 G, 6) 


(NA, 7 o 


3 > 


6) 


15,16 


UNDISTURBED 


WEAKEN 


COMPETITION 


LIMP 








(A, 0 0 10, 6) 


(V, 0 10 0, 6) 


(N, 10 0 0, 6) 


(VA, 0 4 


6, 


5b) 


17,18 


COMPETITION 


RENOUNCE 


ABSURD 


DAZZLE 








(N, 10 0 0, 6) 


(V, 0 10 0, 5a) 


(A, 0 0 10, 6) 


(NV, 1 9 


0, 


5a) 
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Table 3*1 (continued) 

Level IV 

UGF Word (Odd -Numbered Items) 

Item MGF Word 



No, 


Form A 


Form B 


Form C 


(Even- Numbered Items, 
All Forms) 


1,2 


LIMITATION 
(N, 10 0 0, 8) 


CHILLY 

(A, 0 0 10, 8) 


PREDICT 
(V, 0 10 o, 7) 


PENITENT 
(NA, 4 0 6, 


7) 


3A 


PREDICT 
(V, 0 10 0, 7) 


FRAGILE 
{A, 0 0 10, 8) 


TURPENTINE 
(N, 10 0 0, 7) 


TARRY 

(VA, 091, 


5A) 


5,6 


TURPENTINE 
(N, 10 0 0, 7) 


PREDICT 
(V, 0 10 0, 7) 


DURABLE 
(A, 0 0 10, 7) 


BADGER 
(NV, 910, 


7) 


7,8 


CHILLY 

(A, 0 0 10, 8) 


TURPENTINE 
(N, 10 0 0, 7) 


SHELVE 

(V, 0 10 0, 7) 


RADICAL 
(NA, -109 


, 7) 


9,10 


ENCIRCLE 
(V, 0 10 0, 8) 


DURABLE 
(A, 0 0 10, 7) 


LIMITATION 
(N, 10 0 0, 8) 


TIDY 

(VA, 019, 


10) 


11,12 


SHELVE 

{V, 0 10 0, 7) 


LIMITATION 
(N, 10 0 0, 8) 


FRAGILE 
(A, 0 0 10, 8) 


TINGE 

(NV, 640, 


8) 


13, i4 


FRAGILE 
(A, 0 0 10, 8) 


BURNER 

(N, 10 0 0, 8) 


ENCIRCLE 
(V, 0 10 0, 8) 


EPIDEMIC 
(NA, 802, 


8) 


15, l6 


DURABLE 
(A, 0 0 10, 7) 


ENCIRCLE 
(V, 0 10 0, 8) 


BURNER 

(N, 10 0 0, 8) 


EXEMPT 
(VA, 055, 


6) 


17,18 


BURNER 

(N, 10 0 0, 8) 


SHELVE 

(V, 0 10 0, 7) 


CHILLY 

(A, 0 0 10, 3) 


HUDDLE 
(NV, 910, 


7) 



o 
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These instructions were followed by four examples, three of them filled 
out and the fourth presented for the child to try for himself. The first 
example utilized the UGF word ASHORE, and only one sentence was given as 
an illustration. The second and third examples used the MGF words CAMP and 
LEAN; the illustrative sentences used CAMP first as a noun and then as a verb, 
and LEAN first as a verb and then as an adjective. CAMP was chosen for an 
example because it carries the same basic meaning in both noun and verb forms, 
while LEAN was chosen because the verb sense is quite different from the 
adjective sense. CROSS was chosen as an example for the child to try for himself 
because it exhibits considerable polysemyj it is an NVA word in which both same 
and different meanings occur across grammatical parts of speech. The purpose 
of the instructions was to suggest, but only by implication, that the several 
sentences that could be given might exemplify not only different meanings 
of a word but also different parts of speech. 

The reason for asking the subjects to give more than one sentence, if 
they could think of more than one way to use the word, was to see to what extent 
they might tend to use the word In different grammatical functions. At the 
same time, it was thought that the part of speech used in the first sentence 
the child gave would indicate what part of speech was most potent in his 
perception of the word. 

The test forms were printed and the responses were to be written. The 
stimulus words were presented in ''all caps." (This proved to be a mistake 
since it was not intended that the words be interpreted in capitalized form, 
as some of them were, e.g,, General with the name of a general, or Camel 
as the name of a brand of cigarettes.) There were no instructions as to whether 
the illustrative sentences could or could not contain derivational forms 

s, third person singulars, past tenses, etc.) because it was thought 
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that such instructions might place undue constraint on perceiving a word and 
generating a sentence illustrating its use. One of the examples, in fact, 
used LEAN in the form LEANED. 

The test forms were administered to class groups with no time limits. 

In general, two test forms were administered to every child, and at least 
one test form was completed by every child. Average completion time per test 
was approximately 15 minutes; within 20 minutes, over 90 percent of the 
respondents were able to finish a given test form. It should be noted, however, 
that the test required the student to write only l8 sentences. He could write 
more sentences if he could think of "other ways" to use a given word beyond 
his first sentence. Actually, many pupils wrote only one sentence for the majority 
of the words, 

'Hie testing was introduced as part of an experimental project ("We want 
to find out how you and others in your grade use certain words"). Respondents 
were not asked to write their names on the test forms, and there was no record 
of the sex or age of the child. Instructions on the cover page were read 
aloud to the students, the sample items were discussed, and any questions 
raised were answered in a way that would not reveal the true purpose of the 
test. 

Subjects 

The forms were administered to a total of 243 pupils in grades 3; 6, 
and 9 in the Princeton (N.J.) Day School and in grade 6 in a public school 
in the Philadelphia school system. Table 3*2 shows the numbers of pupils 
taking each form at each level. The plan was to give as many forms (levels) 
to each pupil as he could complete within a class period. Since class periods 
varied in length for different schools and different grade levels, and sine;; 

o 

ERylC'Pils took different amounts of time, the number of forms completed by the 
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Table 3.2 

Numbers of Pupils Receiving Each Level and Form at Each of Two Schools, 
Princeton Day School (P.D.S.) and a Philadelphia School 



Form 

A B C Total 





PDS 


Riil. 


Tot. 


PDS 


Phil. 


Tot. 


PDS 


Phil. 


Tot . 


PDS 


Phil. 


Tot. 


Level I 3* 


9 


- 


9 


9 


- 


9 


11 


- 


11 


29 


- 


29* 


6 


24 


2 


26 




6 


ii 


24 


6 


20 


22 


14 


81 


Total 


33 


2 


35 


34 


6 


40 


35 


6 


4l 


102 


14 


116 


II 3 


10 


_ 


10 


10 


_ 


10 


8 


_ 


8 


28 


_ 


28 


6* 


26 


IT 


43 


27 


18 


45 


25 


19 


44 


78 


54 


132* 


9 


28 


“ 


28 


24 




24 


26 




26 


J8 


_= 


_JQ 


Total 


64 


IT 


81 


61 


18 


79 


59 


19 


78 


184 


54 


238 


III 6 


24 


19 


43 


26 


16 


42 


28 


17 


45 


78 


52 


130 


9* 


22 


- ~ 


22 


ii 




21 


26 


_= 


26 


82 




82* 


Total 


53 


19 


72 


53 


16 


69 


54 


17 


71 


160 


52 


212 


IV 6 


15 


- 


15 


14 


_ 


14 


17 


_ 


17 


46 


- 


46 


9 


SI 




21 


21 




21 


28 


*** 


28 


82 




82 


Total 


42 


- 


42 


4l 


- 


4l 


45 


- 


45 


128 


- 


128 



Grade 3 received Level I forms first; grade 6 received Level II forms first; and 
grade 9 received Level III forms first. Thus, the totals (29, 132, and 82 
respectively) represent the ic numbers of cases employed at each grade, summing 
to N = 243. 
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pupils varied. The test booklets were passed out in prearranged order by 

form (A, B, C, A, B, C, ) so that the forms were in effect distributed to 

random thirds of each class group* The first level given to grade 3 was Level I, 
to grade 6, II, and to grade 9, III. After a pupil completed his first test 
booklet, he handed it in and was given a second booklet. The second form-le/el 
given to grade 3 pupils was II, to grade 6 pupils, III, and to grade 9 pupils, IV. 
In grade 9 a t the Princeton Day School, sufficient time was available to give 
most of the pupils a third form- level, namely Level II. In this way it was 
possible to obtain data on the several levels at severed, different grades 
in order to trace developmental trends. It would have been unproductive, 
however, to give the higher levels to the lower grades since those levels 
would have been too difficult for the lower grades. 

Princeton Day School is a private school whose pupils tend to be selected 
from upper middle and upper socioeconomic classes; in contrast, the school 
at which tests were given in the Philadelphia area drew pupils from lower 
middle ar*d lower socioeconomic classes, and had a high percentage of black 
students. Unfortunately, it was possible to obtain data only from 6th grade 
classes in Philadelphia, with Levels I, II, and III. 



o 

ERIC 



S coring of responses 

All responses (both to UGP and MGF words) were scored independently 
by two research assistants. The relatively few discrepancies were resolved 
in discussion between these two and Dr. Joanna Williams, a Visiting Research 
Associate. 

The responses were classified into the following types: 

N Noun (including plurals and possessive forms) 

V Verb (including third person singular aiid past tense forms) 

A Adjective (including comparatives and superlatives in -er, - 1 st ) 
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Adv Adverb 

* Other (prepositions, conjunctions, etc.) 

PresP Present Participle (later combined with verbs) 

PPA Past Participle (later combined with verbs) 

G Gerund (later combined with verbs) 

NS Jninterpre table (for example, a sentence like "I saw a flower blossom" 
in which the part of speech of blossom is ambiguous) 

T " Illegal " transformation of the word to another part of speech, 

e.g., adding -ly , - ness . -tion , or some other derivational form 

D Meaning of the word not understood by the respondent (often resulting 
in grammatical misuse of the word), e.g., interpreting SPARE as 
if it were SPEAR 

I Improper use of form, even when correct meaning is implied, e.g., 

"I am so old that I am getting elder ." 

/N/ Definition sentence in which the word is used in citation form, thus 
giving no indication as to its part-of-speech use, e.g., "What 
does -penitent mean?" 

Some of the respondents used certain words in titles or as brand names. 
GENERAL and PRINCE when used as a part of a title were scored as nouns 
("General MacArthur," "Prince Riilip," etc.). "CAMEL" as the name of a brand 
of cigarettes was scored always as a noun, whether or not it was followed 
by the word "cigarette." Other words in titles were scored according to the 
way the word is used in the title; e.g., FREE in the title of the movie 
"Born Free" was scored as an adjective; DIZZY as the title of a popular record 
was scored as an adjective because the word appears so in the lyrics 
("I'm so dizzy"). 

In a number of cases, it was decided to score attributive nouns as 
adjectives, e.g., SCREEN in "screen door," WAX in "wax candle," 
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results 

The success of this experiment depended in part on the extent to which 
the responses were complete, at least for the first sentence that was to be 
written. Each respondent's paper was scored for the number of sentences 
written as the first response to the stimulus items; Table 3*3 shows the mean 
and standard deviation of this score for each level, grade, and form. The 
maximum possible value of this score was 18. The variation in the means 
reflects the varying difficulty- of the test-form levels in relation to 
the grade levels. To some slight extent it may reflect the fact that some 
forms were given second, with the consequence that a few students were not 
able to finish within the time available. It may also reflect some variation 
in the overall ability of the samples, the students at Princeton Day School 
being Judged to be on the average more able than those at the Philadelphia 
schools where testing was done. On the whole, however, the data were relatively 
complete. The overall percentage of attempts was 91 . 1 $ for Level 1 data, 

?2.3 $ for Level 2, 87 . 6 # for Level 3, and 84. 7$ for Level 4, There were no 
significant differences among forms at a given level and grade, but performance 
varied significantly over grades except in the case of Level 1 between grades 
3 and 6. 

Not all the sentences written represented "valid" uses of the stimulus 
words, however. In the analyses to follow, only those responses were counted as 
valid that used the stimulus words in legitimate ways as nouns, verbs, or 
adjectives.^ The ’’valid" verb responses included uses as present or past 
participles, or gerunds. Responses coded as NS (Uninterpretable ), T ("Illegal 
trans format ion" to other parts of speech by the use of derivational suffixes 
and the like), D ("Meaning not understood"), I ("Improper use of form"), 




A few words elicited were used as adverbs, e.g., LAST. Such responses were 
rare, however, and for the purposes of this experiment such responses were 
discounted, i.e., considered as "invalid." 
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Table 3.3 

Number of Items Attempted (with 'l8th Sentence" Written) 



Level Grade 


N 


Form 


rv 


Form 


B 


Form 


c 


All : 


Forme 


56 Completed 






X 


a 


X 


0 


X 


a 


X 


0 




1 3* 


29 


: 6 .r 8 


1 . 4 o 


17.44 


0 .68 


16.27 


2.38 


16.79 


1.77 


F= 1.05 n.s. 


6 


81 


.. 6.42 


3.34 


15-97 


4.17 


16.43 


3.36 


16.26 


3-67 


F= .15 n.s. 


Total 


116 














16. 40 


3.31 


91*1 


















F 1,118 


- 0.55 


n.s. 


2 3 


28 


. 4.20 


2.18 


13.30 


3.23 


12.87 


3.95 


13.50 


3.19 


P^.38 n.s. 


6* 


132 


.7.60 


1.06 


17.76 


0.60 


17.57 


1.01 


17.64 


0.91 


5^.52 n.s. 


9 




16.14 


3.06 


14.92 


4.00 


15.92 


3.51 


16.00 


3.52 


1^.03 n.s. 


Total 


238 














16.62 


2.75 


92.3 


















F 2,35 ' 


= 38.1 


p < .001 


3 6 


130 


l 4 .05 


5.34 


15-00 


4 .o 4 


14.36 


4.39 


14.46 


4.64 


F =.46 n.s. 


9 * 


^82 


17.83 


0.46 


17.89 


0.31 


17.85 


O.36 


17.85 


_o^2 


F= . 18 n.s. 


Tota j 


2 J 














15. 78 


4 .oo 


87.6 


















F 

1,210 


“ 43,20 p < .001 


: r 


46 


12.27 


4.30 


11.53 


4.46 


13.07 


*.79 


12.34 


4.58 


F =.42 n.s. 


9 


J?2 


16.93 


1.36 


16.78 


1.50 


16.96 


.1.21 


16.89 


1.36 


F=.l 4 n.s. 


Total 


126 














15.26 


3.67 


84.7 


















*1,126 


= 68.9 


p < .001 



y Fix-fit level given at thdse grades. 



40 




-39- 



/N/ ("Definition sentence"), or 0 (No response) were considered "invalid/ 1 

It is of interest to consider, first, the extent to which "valid" 
first sentences were written for the UGF words. The validity of the experiment 
itself depended on how well the subjects responded to the UGF words and the 
extent to which they used these words in the expected parts of speech, since to 
the extent that they did not respond to the UGF wolds according to expectation, 
there would be no possibility of a priming effect. Table presents the 
relevant data. The first three columns of this table show the percentages 
with which the students gave valid sentences using the stimulus words. The 
variation in percentages reflects not only the types of variation mentioned 
above (the order in which the forms were given, and the varying composition 
of the samples), but also the relative difficulty of the words. Most of the 
words were responded to in a valid way by a large majority of the students 
at a given grade level, but a few were of considerable difficulty. Words 
that were validly employed in sentences by fewer than 2/3 of the students 
at a given grade level were the following: DESPERATE, ORGANIZE, PERSONAL, 

and RENOUNCE at grade 3; and ABSURD, RENOUNCE, BURNER, and LIMITATION at grade 6. 
In general these findings are in agreement with the Dale ratings. 

The final three columns of Table 3-3 show the percentages with which the, 
UGF words were used in the three designated psrts of speech, noun, verb, end 
adjective, as represented in the codings. In nearly every case, the stimulus 
word was used in the expected part of speech. It is probable that a few 
nonzero percentages that are nevertheless close to zero represent coder error. 
The only words for which there seem to be significant departures from the 
expected part-of-speech use are BURNER, coded in 9 *856 of the valid instances 
as an adjective, and SHELVE, expected to be used as a verb but actually 
used in 65.1$ of the valid responses at Level 4 as a noun in the form 

ERIC 4 7 
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Word 

AFRAID 

COUNTRY 

COUSIN 

ENTER 

EXPLAIN 

HONEST 

PRINCE 

REAL 

SEND 



Word 

ARISE 

CAMEL 

DESPERATE 

LANTERN 

OVEN 

organize 

PERSONAL 

RAINY 

SOFTEN 

*First 



o 




Table 3.4 

First Sentence" Responses to Grammatically Unambiguous (UGF) Words 

Level I 

Percent Valid Responses 



Th. 


Dale 


Gr. 3* 
(N=29) 


Gr .6 

(N=87) 


Gr .9 


lb 


1 


96.5 


90.8 


— 


la 


1 


100.0 


93.1 


— 


2a 


1 


86.2 


97.7 


— 


lb 


1 


96.5 


84.7 


— 


2a 


1 


89.7 


86.2 


— 


2a 


1 


86.2 


87.4 


— 


lb 


1 


93-1 


79-3 


— 


lb 


1 


100.0 


83.9 


— 


la 


1 


100.0 


98.8 


— 



Level II 



Th, 


Dale 


Gr. 3 
(N=e8) 


Gr .6* 
(N=132) 


Gr .9 
(N=T8) 


3a 


1 


67.9 


91.7 


89.7 


4b 


1 


96.4 


100.0 


92.3 


4a 


5 


60.7 


89.4 


85.9 


4b 


1 


82.1 


99.2 


78.2 


3b 


1 


100.0 


99.2 


98.7 


4b 


3 


60.7 


90.9 


74.4 


3b 


3 


60.7 


93.2 


87.2 


4a 


1 


96.4 


99.2 


87.2 


4b 


2 


60.7 


94.7 


80.8 



level given at these grades. 



Com- 


No. 

Valid 


Part of Speech 
(Percent) 


bined 

(n=ii6) 


Responses 


Noun 


Vb. 


Adj. 


92-2 


107 


0.9 


-- 


99.1 


94.8 


110 


98.2 


0.9 


0.9 


94.8 


110 


99.1 


. 0.9 


— 


87.1 


101 


-- 


100.0 


— 


87.1 


101 


-- 


100.0 


— 


87.1 


101 


— 


— 


100.0 


82.7 


96 


100.0 


— 


— 


87.9 


102 


— 


— 


100.0 


99-1 


115 


0.9 


99.1 


— 



Com- 


No. 

Valid 


Part of Speech 
( Percent) 


bined 

(H=238) 


Responses 


Noun 


Vb. 


Adj . 


88.2 


210 


0.5 


98.5 


1.0 


97.1 


231 


97-8 


— 


2.2 


84.9 


202 


— 


— 


100.0 


9 O .3 


215 


100.0 


— 


— 


99-2 


236 


98.3 


0.4 


1.3 


81 . 9 


195 


1.0 


99.0 




87.4 


208 


1.0 


— 


99.0 


95.0 


226 


0.9 


— 


99.1 


86.1 


205 


1.0 


-- 


99.0 
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Table 3.4 (continued) 



Level III 

Percent Valid Responses 















Com- 


No. 

Valid 


Part of Speech 
(Percent) 


Word 


Th. 


Dale 


Gr .3 


Gr .6 
(N=130) 


Gr . 9 * 
(N=82) 


bined 

(N- 212 ) 


Responses 


Noun 


Vb. 


AdJ. 


ABSURD 


y 

0 


5 


— 


62.3 


98.8 


76.4 


162 


— 


— 


100.0 


COMPETITION 


6 


4 


— 


73.1 


98.8 


83.0 


176 


100.0 


— 


— 


DISTRIBUTE 


5a 


7 


— 


90.0 


97.6 


92.9 


197 


0.5 


99.5 


— 


LONESOME 


5a 


1 


— 


86.9 


100.0 


92.0 


195 


— 


— 


100.0 


ORCHESTRA 


5b 


3 


-- 


93.8 


97.6 


95.3 


202 


100.0 


— 


— 


RAINFALL 


6 


4 


-- 


88.5 


100.0 


92.9 


197 


99.0 


1.0 


— 


RENOUNCE 


5a 


7 


— 


46.2 


78.0 


58.5 


124 


— 


100.0 


— 


UNDISTURBED 


6 


4 


— 


77.7 


100.0 


86.3 


183 


— 


-- 


100.0 


WEAKEN 


6 


1 


— 


75.4 


93.9 


82.5 


175 


-- 


100.0 


— 










Level IV 


Com- 


No. 

Valid 


Part of Speech 
{ Percent) 


Word 


Th. 


Dale . 


Gr . 3 


Or .6 
(N=46) 


Gr .9 

(N= 62 ) 


bined 

(N=128'i 


Responses 


Noun 


Vb. 


AdJ. 


BURNER 


8 


2 


— 


65,2 


100.0 


87.5 


112 


90.2 


— 


9.8 


CHILLY 


3 


1 


— 


76.1 


92.7 


86.7 


111 


— 


— 


100.0 


DUFABIE 


7 


4 


— 


78.3 


96.3 


89.8 


115 


— 


-- 


100.0 


ENCIRCLE 


8 


3 


— 


71-7 


96.3 


87-5 


112 


-- 


100.0 


— 


FRAGILE 


8 


3 


— 


80.4 


97.6 


91.4 


117 


— 


— 


100.0 


LIMITATION 


8 


4 


— 


4S .6 


96.3 


78.1 


100 


98.0 


— 


2.0 


PREDICT 


7 


4 


— 


91.3 


87.8 


89.1 


114 


0.9 


99.1 


— 


SHELVE 


7 


7 


— 


73.9 


87.8 


82.8 


106 


65.1 


3^.9 


-- 


TURPENTINE 


7 


3 


— 


89.1 


98.8 


95-3 


122 


98.4 


0.8 


0.8 



* 



Flrct level given at this grade. 
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SHELVES (plural). In the main, subjects responded to the UGF words in the 
manner in which they were expected to respond to them; at least it may be 
said that they responded to them sufficiently in accordance with expectation 
to validate the design of the experiment, which assumed that they would in fact 
respond to the UGF words in the anticipated parts of speech. 

Table 3*5 gives data on the extent to which the subjects responded 
validly to the MGF words, i.e., wrote "first sentences" using these v<ords 
in legitimate ways. One has the impression that the students had more difficulty 
in responding to MGF words than to UGF words. Words validly used by fewer 
than 2/3 of the students at a given grade level were as follows: SAVAGE, 

MORAL, INDIVIDUAL, and MATURE, at grade 3; ANIMATE, DAZZLE, PENITENT, TARRY, 
RADICAL, TINGE, EPIDEMIC, EXEMPT, and HUDDLE at grade 6; and ANIMATE, PENITENT, 
and TINGE at grade 9 . One hesitates to draw the conclusion, however, that 
MGF words are in general more difficult to put into sentences than UGF 
words of comparable frequency, because the samples of UGF and MGF words used 
in this experiment were too small and too poorly matched, even in terms of 
Thorndike frequency-rank indices, to support such a conclusion. It was not 
within the scope of this research to pursue the interesting possibility suggested 
here. 

The last three columns of Table 3,5 give data on the parts of speech in 
which the MGF words were used. Because this experiment was not designed to 
obtain normative data they should not be regarded as necessarily giving 
good estimates for normative purposes. More trustworthy data on these same 
words will be presented in Chapter IV, 

Is parsing behavior subject to a "priming effect"? 

In order to study the main question which this experiment had been designed 
O iver, all the "valid response" data were arranged so as to compare the 

ERIC 
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Table 3-5 

Responses to Grammatically Ambiguous (MGF) Words 





Level I 


$ Valid 


No. Valid 


Part of Speech 
{ Percent) 


Word 


Th. Dale MGF Vector Grade 


Responses Responses 


Noun 


Verb Ad j . 


SAVAGE 


2b 1 4 0 6 3 


65 . 5 (N= 29 ) 


19 


52.6 


47.4 




6 


100.0(N=87) 


81 


56-3 - 


2,3 41.4 











2 


91 .4(N=ll6) 


106 


55.7 


1.9 


42.5 


LIVE 


la 


1 


0 9 1 


3 


93-1 


27 


— 


92.6 


7.4 










6 


87.4 


76 _ 


— 


85.5 


1 4.5 










£ 


88.8 


103 


— 


67-4 


12.6 


BLOSSOM 


2 a 


1 


820 


3 


96.5 


28 


78.6 


21.4 


— 










6 


90.8 


T9 


64.6 


35.4 


— 










£ 


92.2 


107 


68.2 


31.8 


— 


GENERAL 


la 


1 


109 


3 


93-1 


27 


81.5 


— 


18.5 










6 


93.1 


81 


59-3 . 


— 


40.7 










£ 


93-1 


108 


64.8 


— 


35.2 


FREE 


la 


1 


019 


3 


82.8 


24 


— 


4.2 


95-8 










6 


85.1 


74 


— 


— 


100.0 












87.0 


101 


— 


1.0 


99. 0 


GLANCE 


2b 


1 


6 4 0 


3 


89.7 


26 


42.3 


57.7 


— 










6 


89.7 


78 


66.7 


33.3 


— 










£ 


89.7 


104 


60.6 


39.4 


— 


INSTANT 


2b 


1 


901 


3 


93-1 


27 


63.0 


— 


37.0 










6 


77.0 


67 


47.8 


— 


52.2 










£ 


81.0 


94 


52.1 


— 


47.9 


DIRECT 


lb 


1 


0 6 4 


3 


72.4 


21 


— 


71.4 


28.6 










6 


67.8 


59 


— 


33.9 


66.1 



t 68.9 8 c — 43.8 56.2 

3 96.5 28 3-6 96.4 

6 78.2 68 17.6 82.4 

£ 82.8 96 13.5 86.5 
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JUMP 



2a 



2 8 0 



o 
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Table 3.5 (continued) 











Level II 






Part 


of Speech 












% Valid No. 

Responses Ree 


, Valid 


( Percent') 




Wort 


Th. 


Dale 


MGF Vector 


Grade 


jponses 


Noun 


Verb 


Adj . 


ELDER 


3b 


1 


2 0 8 


3 


7l.4(N=28) 


20 


60.0 


— 


40.0 










6 


88.6(n=132) 


117 


65.O 


— 


35.0 










9 


89.7(N=*78) 


70 


81.4 


— 


18.6 










£ 


87.0(M=238) 


207 


70.0 


— 


30.0 


SPARE 


2a 


4 


0 8 2 


3 


96.4 


27 


18.5 


22.2 


59.2 










6 


99.2 


131 


0.8 


4l.2 


58.0 










9 


100.0 


78 


3.8 


48.7 


47.4 










£ 


99.2 


236 


3-8 


41.5 


cl. f . 


SCREEN 


4a 


1 


9 10 


3 


96.4 


27 


66.7 


— 


33.3 










6 


100.0 


132 


59-1 


8.3 


32.6 










9 


97.4 


76 


59.2 


13.2 


27.6 










£ 


98.7 


235 


60.0 


8.9 


31.1 


MORAL 


3a 


4 


10 9 


3 


28.6 


8 


87.5 


— 


12.5 










6 


84.1 


ill 


82.O 


— 


18.O 










9 


80.8 


63 


65.1 


— 


3^9. 










£ 


76.5 


182 


76.4 


-- 


23.6 


LAST 


la 


1 


12? 


3 


89.3 


25 


— 


4.0 


96.0 










6 


100.0 


132 


0.8 


9.1 


90.2 










9 


91.0 


71 


4.2 


12.7 


83.1 










£ 


95.8 


228 


1.8 


9.6 


88.6 


WAX 


3a 


1 


4 6 0 


3 


89.3 


25 


40.0 


44.0 


16.0 










6 s ' 


98.5 


130 


51.5 


32.3 


16.2 










9 


82.0 


64 


54.7 


.37--I. 


7.8 










£ 


92.0 


219 


51.1 


35.2 


13.7 


INDIVIDUAL 


3a 


3 


7 0 3 


3 


21.4 


6 


50.0 


— 


50.0 



6 


88.6 


117 


65.0 


35.0 


9 


69.2 


1 

- 3 - 


75-9 r=__ 


24.1 


z 


7^-3 


*77 


67.8 


32.2 



0 
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Table 3-5, Level II (continued) 













$ Valid 


No. 


. Valid 


Part of Speech 
( Percent) 


Word 


Th« 


Dale 


MGF Vector 


Grade 


Responses 


Responses 


Noun 


Verb 


Adj. 


MATURE 


4a 


4 


0 5 5 


3 


21.4 




6 


— 


16.7 


83.3 










6 


89.4 




118 


— 


6.8 


93.2 










9 


69.2 




54 


. 


14.8 


85.2 










E 


74.7 




178 


— 


9.6 


90.4 


DIP 


3a 


1 


2 8 0 


3 


78.6 




22 


27.3 


72.7 


— 










6 


98.5 




130 


63.8 


36.2 


— 










9 


69.2 




54 _ 


66.7 


3d a 


1-9 










Z 


86.5 




206 


60.7 


38.8 


0.5 










Level III 


$ Valid 


No 


. Valid 


Part of Speech 
( Percent) 


Word 


Th. 


Dale 


MGF Vector 


Grade 


Responses 


Responses 


Noun 


Verb 


Adj. 


OFFICIAL 


3a 


3 


5 0 5 


6 


93.1(N=130) 


121 


31.4 


— 


68.6 










9 


97.6(N=82) 


80 


75.0 


— 


45.0 










E 


94.8(N=212) 


201 


40.8 


— 


59.2 


ANIMATE 


6 


6 


0 9 1 


6 


37-7 




49 


-- 


93.9 


6.1 










9 


54.9 




49 


— 


57.8 


42.2 










E 


44.3 




94 


— 


76.6 


23.4 


CHART 


5b 


1 


9 10 


6 


90.8 




118 


88.1 


11.9 


— 










9 


97.6 




80 


. 73 JL . 


25.0 


1.2 










E 


93.4 




198 


82.3 


17.1 


0.5 


PRIMARY 


5b 


5 


10 9 


6 


71.5 




93 


15.1 


— 


84.9 










9 


100.0 




82 


17.1 


— 


82.9 










E 


82.5 




175 


16.0 


— 


84.0 


DIZZY 


6 


2 


0 19 


6 


86.2 




112 


— 


-- 


100.0 










9 


100.0 




82 


— 


— 


100.0 










E 


91.5 




194 


— 


— 


100.0 


CHISEL 


6 


2 


4 6 0 


6 


72.3 




94 


83.0 


17.0 


— 










9 


100.0 




82 


6iU_ 


30-5 _ 


-- 


o 








E 


83.0 




176 


76.7 


23.3 


— 
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Word 

CARDINAL 



LIMP 



DAZZLE 



Word 

PENITENT 



TARRY 



BADGER 



RADICAL 



TIDY 

TINGE 

o 
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iable 3.5, Level III (continued) 



Part of Speech 

$ Valid ho- Valid (Percent) 



Th 


Dale 


MGF Vector 


Grade 


Responses Responses 


Noun 


Verb 


Adj. 


6 


3 


703 


6 


79-2 


103 


83.5 


— 


16.5 








9 


100.0 


82 


70.7 


— 


29.3 








£ 


87.2 


185 


77.8 


— 


22.2 


5b 


1 


0 4 6 


6 


78.4 


102 


14.7 


51.0 


34.3 








9 


96.3 


79 


26.6 


32.9 


40.5 








£ 


85.3 


181 


19.9 


43.1 


37.0 


5a 


3 


19 0 


6 


61.5 


80 


11.2 


83.8 


5.0 








9 


82.9 


68 


13.2 


85-3. 


1.5 








£ 


69.8 


148 


12.2 


84.5 


3-4 








Level IV 


# Valid No. Valid 


Part of Speech 
(Percent) 


Th . 


Dale 


MGF Vector 


Grade 


Responses Responses 


Noun 


Verb 


Adj. 


•7 


6 


4 0 6 


6 


36.l(N=46) 


12 


8.3 


— 


91. T 








9 


4l.5(N=82) 




8.8 


— 


91.2 








£ 


35 > 9 (N= 128 ) 


46 


8.7 


— 


91.3 


5a 


4 


091 


6 


65.^ 


30 


— 


83.3 


16.7 








9 


81.7 


67 


- 3-0- 


88.1 


0 








£ 


75-8 


97 


2.1 


86.6 


11.3 


7 


4 


9 10 


6 


80.4 


37 


8l.l 


18.9 


— 








9 


86.6 


71 


64.8 


35.2 


— 








£ 


84.3 


108 


70.4 


29.6 


— 


7 


5 


-10 9 


6 


45.6 


21 


14.3 


— 


85.7 








9 


100.0 


82 


57.3 


— 


42.7 








L 


80.5 


103 


48.5 


— 


51.5 


10 


3 


0 19 


6 


82.6 


38 


. - 


21.1 


78.9 








. 9 


98.8 


81 


— 


18 .? _ 


81.5 








l 


93.0 


U9 


— 


19.3 


80.7 


8 


4 


6 4 0 


6 


17.4 


8 


87.5 


— 


12.5 



9 


61.0 


. 50 


92.0 


8.0 


£ 


45.3 


58 


91.4 


6.9 1.7 
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Table 3 . 5 , Level IV (continued) 



Word 

EPIDEMIC 


Tn. 

8 


Dale 

k 


MGF Vector 
8 0 2 


Grade 

6 

ft. _ 


$ Valid 
Responses 

1+5 . 6 

95.1 


No. Valid 
Responses 

21 

78 _ 


Part of Speech 
(Percent) 

Koun Verb Adj . 
95.2 — 4.8 
97.4 — 2.6 










£ 


77.3 


99 


97.0 


3-0 


EXEMPT 


6 


5 


0 5 5 


6 


4.3 


2 


— 


(50.0) (50.0) 










9 


67.1 


_55_ 


— 


20.0 80.0 










Z 


1+4.5 


57 


— 


21.1 78-9 


HUDDLE 


7 


3 


19 0 


6 


63.0 


29 


55.2 


44.8 



9 


100.0 


82 


65-9_ 


34.1 


— 


£ 


86.7 


111 


63.1 


36.9 
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probabilities of giving a certain part of speech for a given MGF word as a 
function of the part of speech in which the preceding UGF word had been classified. 
(Here we have reference to the classification that had been assigned to the 
UGF word prior to the experiment , not to the classification assigned by the 
subject. As noted above, however, nearly all UGF words were actually used in 
the parts of speech in which they had been previously classified.) Data 
were pooled over schools and grades. This resulted in a 3 x 3 contingency 
table for each MGF word, for (part of speech of preceding UGF word) x (part 
of speech in which the MGF word was used in the first sentence written). 

It was then possible to apply a chi-square test to the contingency table. 

In many cases, when frequencies in <^ne column summed to zero or a small number, 
it was necessary to collapse u he contingency table to a 3 x 2 table; in a few 
cases, no test was possible because all or nearly all frequencies occurred 
in a single column. 

For example, at Level 2, the MGF stimulus WAX had been preceded by the 
UGF (U) stimulus CAMEL in Fom B, the UGI (V) stimulus SOFTEN in Form A, and 
the UGF (A) stimulus PERSONAL in Form C. With valid response data from 
grades 3, 6, and 9 pooled, the resulting contingency table was as xollows: 



Part of speech written 
for WAX 



Preceding item 


Form 


N 


V 


A 


Total 


N 


B 


87 


26 


11 


74 


V 


A 


4l 


2k 


9 


74 


A 


C 


34 


21 


10 


71 






112 


77 


30 


219 


When columns V and A 


in the above 


table 


were combined, 


computation yielded 


a chi-squared value 


of 0.88, d.f . 


- 2, 


p > .70. 







0 
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Of the 28 (out of a possible 36 ) tests that were made in this way, 

only one test yielded a chi-squared value with p < . 05 ; this was for the word 
2 

DAZZLE, with X = 7.99, d.f. - 2 , p < .025* Since one would expect about one 
such result out of 28 by chance, it is unlikely that any reed significance 

can be attached to it. Examination of the data for DAZZLE sjggests that if 

anything, there was a negative priming effect; that is to say, an adjective 

was less likely to be written when the item was preceded by an adjective. 

Examination of the data grade by grade revealed no case in which there 
was likely to be some sort of significant interaction of a priming effect 
with grade. 

The conclusion for this pilot experiment was clear; at least under 
the conditions of the experiment, where each I^GF stimulus was preceded by one 
UGF stimulus, no significant priming effect was detectable. It appeal's that 
when Ss are presented with a list of words in isolation and are asked to make 
up sentences illustrating each word, they perceive and respond to each wore 
as a separate entity, and there are no significant intralist influences on these 
percept ions . 

It is possible, of course, that a priming effect might have been more 
prominent if Ss had been asked to make up only ore sentence per word. In 
this experiment they were asked to make up more than one sentence if they 
could think of different ways to use the word, and many Ss did write 
more than one sentence for a given word. Table 3*6 reports data bearing on 
the extent to which Ss tended to write more than one sentence for a given 
stimulus word, depending on whether it was a UGF or E5GF word, and the extent 
to which there was a change in part of speech when they wrote the second 
sentence for an MGF stimulus word. The data in Table 3.6 are pooled over 
forms since there was no evidence of any significant differences among 

o 

ERIC orras in this respect. 
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From Table 3*6, it appears that (l) as grade increases, there is an increas- 
ing tendency to write a second or third sentence; (2) part icularly at the higher 
grades, more sentences are written in response to MGF stimuli than to UGF stimuli 
and (3) as grade increases, there is an increasing tendency to change the part 
of speech when the second sentence is written. However, these results are 
probably to some extent confounded with a number of extraneous variabJes, such 
as the nature of the samples, whether the form was the first one completed, 
the polysemy vs, polysyntagmy of the words, etc. Analysis of some of these 
matters will be more profitable in connection with the experiment to be reported 
iii the next chapter, where the relevant data are more ample. 
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Table 3.6 

/ 

Data on Second or Third Sentences Written to the Stimuli 
(Data pooled over forms) 







Ko. of UOF items 


No. of MGF items 


No. of MGF items 






for which a 2 nd 


for which a 2 nd 


in which the 2 nd 






or 3 rd sentence 


or 3 rd sentence 


sentence changed 






was witten 


was written 


the part of speech 






X a 


X 0 


X 0 


Grade 


N 








3 


29 


3.14 3.32 


3.59 3^02 


1.07 1.05 


6 


_§z 


1.4l 1.95 


2.42 2.45 


1.49 1.66 


Total 


116 


F 1 , ll 4“ n * 54 - P <'*° 01 


F^ ll4 = 4.24. p <..05 


F 1,H4 =1 - 65 * n - s ' 


3 


28 


1.18 1.69 


1.46 1.88 


0.46 O .87 


6 


132 


3.94 2.80 


5.48 2.11 


2.82 1.61 


9 


-18 


3.32 2.47 


6.40 2.24 


4.04 1.91 


Total 


238 


F 2 ^ 235 = 13.07. pC.OOl 


F 2> 235 = 55.f < .° 01 


f 2 , 235 - 48 - p < - 001 


6 


130 


1.38 1.85 


2.61 2.31 


1.07 1.28 


9 


_8g 


4.07 2.66 


7.07 1.78 


4.22 1.65 


Total 


212 


Vjlo-t 4 -^- 001 


F i ,» o - 221 - p< - 001 


F 1,210- 240 * p< - 001 


6 


46 


0.1j2 0.68 


0.39 0.88 


0.28 0.68 


9 


-82 


4.06 2.61 


3.94 2.10 


2.70 1.91 


Total 


128 


f i ,126 = 84 * p<i001 




F l ,126 = 67 * P <‘ 001 
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Chapter IV 

Grammatical Perceptions of 240 MGF Words at Three Grade Levels: 
A Normative Study 



Introduction 

Since it had been determined, in the pilot experiment reported in Chapter III, 
that there were apparently no significant sequential effects in the grammatical 
perceptions of words presented in isolation, it became possible to proceed 
to the study of a much larger pool of MGF words. Data on a large number of 
MGF words were required for use in designing the main experiment (to be reported 
in Chapter V) on children's comprehension of MGF words in various contexts. 

As in the previous experiment, the data that were of most interest were 
the empirical probabilities with which each MGF word was used in the several 
parts of speech when the children were presented with the word in isolation 
and asked to use it in one or more sentences. When a word was used with a 

high probability in a given part of speech in the first sentence written by 

a respondent, it was assumed that the word was well known in that part of 
speech by children at a given grade level. When a word was used with a low 
probability in a given part of speech, it was assumed that the word was less 
veil known in that part of speech. However, attention was directed also to 
the probability with which a word was used in a different part of speech in 
a second sentence. Tf the probability of changing grammatical function in 
a second sentence should prove to be relatively high, it could be assumed 
that the word was relatively well known in the respective parts of speech. 

These data would be useful, it was thought, in identifying words whose relatively 

unusual grammatical functions were unlikely to be known by children at the 

several grade levels involved in this study. 
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A supplementary question of interest here was that of how successful 
the respondents were in using the MGF words in sentences. The proportions of 
respondents who could use the words successfully in sentences represented data 
that would index the relative difficulties of the words. These indices could 
be compared with other information that might bear on word difficulty, such as 
the Thorndike frequency-rank indices and the Dale ratings. 

It was also of interest to note developmental changes, if any, in respondents' 
success in using the MGF words in sentences, in the probabilities with which 
they used them in the several possible parts of speech in the first sentence 
written for each word, and in the probabilities with which they used the words 
in changed grammatical functions in a second sentence. 

Finally, it was of interest to compare the empirical par t-of -speech 
proportions with the TI MGF vectors 11 that had been assigned to the words by methods 
described in Chapter II, 

The pilot experiment reported in the previous chapter yielded limited 
data on 36 MGF words. The present chapter reports further data on those words 
as well as data on 204 additional MGF words. Since this study was not concerned 
with children's knowledge of UGF words, no further data were obtained for 
such words. 

Method 

In order to obtain data on a large number of MGF words and at the same time 
limit the words presented to each respondent to a reasonable number, nine 
different test forms were prepared, each with 26 or 27 words. These comprised 
three forms at each of three levels of difficulty as determined by Thorndike 
frequency-rank indices. (The data on Dale ratings of words had not been developed 
at this stage of the research.) The forms included the 36 words previously 
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studied, plus 204 additional words that were selected from the M GF compilations reported 
in Chapter II as follows: 

Level 1 36 words from categories la and lb (Thorndike ratings) 

words from categories 2a and 2b 
72 words, 24 in each of three forms (i-A, I-B, I-C) 

Level 2 4l words from categories 3a and 3b 

31 words from categories 4a and 4b 

72 words, 24 in each of three forms (H-A, II-B, Il-C) 

Level 3 23 words from categories 5& and 5b 

19 words from category 6 
18 words from category 7 

60 words, 20 in each of three forms (III-A, III-B, III-C) 

The 204 additional MGF words were distributed randomly among the three 
forms at each level; the distribution that resulted was as follows, in 



of types of MGF words 


according to 


the MGF 


vectors; 






Level 1 


Level 2 


Level 3 


Total 


Type NV 


42 


60 


49 


151 


Type NA 


16 


6 


8 


30 


Type VA 


5 


0 


2 


7 


Type NVA 


8 


6 


1 


15 


Type N,V,A,0ther 


1 


0 


0 


1 


Total 


72 


72 


60 


204 



In order to insure that reliable additional data would be obtained 
on the 36 MGF words used in the previous experiment, appropriate subsets 
of these were placed early in each form so that they would have a higher 
likelihood of being responded to if the student did not complete his form 
in the time allowed. Thus, the first three words of Level 1 and Level 2 
forms were MGF words used in Levels I and II of the previous experiment, 
respectively, and the first six words of Level 3 were MGF words from 
O relsllland IV of the previous experiment* Beyond these words, the 
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additional MGF words were randomly ordered within forms. 

As in the previous experiment, each test form had a cover page giving 
instructions; this cover page was identical for all nine forms. (A sample 
form is shown in Appendix C.) The instructions reed as follows: 

"We want to find out how you and others in your grade use certain 
words . 



"For each word write two short, complete sentences showing that you 
know how to use that word. Write the first sentence that you think of. 

Then, write another sentence using the word in a different way.'* 

These instructions were followed by four examples, three of them filled 
out and the fourth for the child to try for himself. All sample words 
vere MGF words of high frequency ( right , pai nt . clear , and rest ), and the 
samples illustrated different grammatical functions of these words. It 
was hoped in this way that the subjects would receive an implicit set to 
write words in different grammatical functions, even though no specific 
mention of grammatical function was made. The reason for asking each subject 
to write two sentences was that it was desired to investigate the extent 
to which different, grammatical functions would be used under these instructions. 
At the same time, it was assumed, as before, that the first sentence written 
would illustrate the grammatical function in which the word was perceived 
with highest potency. 

The test forms were printed and the responses were to be written. 

From experience with the earlier experiment, where the words were 
printed in "all caps" and were olten interpreted by the subjects as proper 
nouns or adjectives, all words were printed in lover case. 

As in the previous experiment, there were no instructions as to whether 
O sentences to be written by the subject could contain derivational forms 
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since lack of such instructions had not caused difficulty in the previous 
experiment. Nevertheless , the samples on the cover page used the words 
only in their entry forms. 

Because each form asked the student to write as many as 5^ sentences 
(i,e., two sentences for each of words in the forms at Levels 1 and 2 
and for each of 26 words in the forms at Level 3), it was expected that 
completion of each form would take most of a class period. 

Subjects 

It was planned to have each form of each level completed by approximately 

100 students of a given grade in order to obtain reasonably reliable data 

/ 

on the proportions with which different parts of speech were used. Originally 
it was hoped to obtain data for Level 1 at grades 3 and 6 and for Levels 
2 and 3 at both grades 6 and 9. The difficulty of obtaining the required 
numbers of subjects and the costs involved made it necessary to abandon 
some parts of this plan. It was decided to concentrate on obtaining data 
for Level 1 on grade 3, Level 2 at grades 6 and 9 , and Level 3 for grade 9 
only. (A few cases were obtained for Level 1 at grade 6, but not enough 
to justify analysis,) 

An effort was made to obtain cooperating schools from communities 
of different types (middle-clas^ suburban, small turn, and inner-city) 
and to rru'Ae the representation as comparable as possible from grade to 
grade. It is a matter of judgment as to what degree this effort was 
successful. Table k,l shows the number of cases obtained from each of four 
communities, by level and grade: 
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Table 4.1 





Level 1 


Level 2 


Level 3 




Community 


Gr. 3 


Gr. 6 


Gr. 6 


Gr. 9 


Gr. 9 


Total 


Edison, N. J. 


40 


— 


6 l 


— 


62 


163 


Ewing, N, J, 


75 


55 


84 


— 


— 


2l4 


Atlantic City, N. J* 


123 


— 


168 


305 


339 


935 


Philadelphia, Pa. 


64 


— 


92 


— 


27 


183 




302 


55 


405 


305 


428 


1495 


Edison. N, J. is 


a community that 


includes 


a wide 


range of 


neighborhoods 



with concentration, however, on lower middle-class and upper lower-class 
white- and blue-collar workers; the schools at which testing was conducted 
included few blacks, ^ wing, N. J. is primarily a middle-class suburban community. 
Atlantic C i ty, N. J. is essentially a medium-sized city that includes both 
middle- and lower-class neighborhoods, with a considerable proportion of 
black students in the schools where testing was done. Its one high school 
contributed all the grade 9 cases at Level 2 and a majority of the cases 
for Level 3; grade 9* The testir.g done in Philadelphia was at two schools, 
one (grade 3 and 6 cases) in an urban redevelopment project, and the other 
(grade 9 cases) in an inner-city ghetto. In the aggregate, it is believed 
that the data over the various levels ard grades come from reasonably 
comparable and representative samples, with the exception of the data 
for Level 1, grade 6 , which were in any case too meager to justify being 
analyzed . 

Since the forms were distributed to random thirds of each class group 
(by prearrangement of the forms in the order A, B, C, A, B, C, ...), approximately 
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equal numbers took each form at each level and grad The method of administration 
was similar to that described for the previous pilot experiment. 



o 
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Scor3ng of data 

Every position on each respondents test form vab inspected by a research 
assistant in order to classify the response according to the following key: 

0 No response (i.e*, nothing written at sill). 

1 Stimulus word used as a NOUN (including possess ives and plural forms), 

2 Stimulus word used as a VERB (including forms in -s, -ed, and - ing y 

except when forms in -ing or - ed would properly be classified as 
nouns or adjectives, e.g., BUILDING, in which case the response 
v/as coded T; see below), 

3 Stimulus word used as an ADJECTIVE (including comparative and 

superlative forms), 

4 Stimulus word used as an ADVERB, 

5 Stimulus word used in some OTHER part of speech. 

A Response not codable because of grammatical AMBIGUITY. 

C Stimulus word is used as a proper noun or adjective, i.e,, CAPITALIZED 
(However, certain capitalized words were classified in the 
appropriate part of speech when they occurred in phrasal titles, 
e.g., FREE was classified as an adjective in the movie title 
"Born Free.") 

I Word used in an IMPLIED TRANSFORMATION to another word or part 

of speech, e.g,, "Is this individual wrapped cheese?" (for individually 
or "your class used the associate law of addition." (for associative ) . 
Q Word used in citation or QUOTATION form, i.e., without being used 
in any part of speech, as in "What does 'epidemic' mean?" 

R Stimulus word not recognized in its proper sense or meaning, 
e.g., FILL mistaken for FEEL* 
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T Illegal transformation of word to another part of speech, e.g., 

BUILD transformed to BUILDING and used as a noun. 

U 'Jninterpre table because of illegibility or other reasons not 
included above. 

Informal reliability checks showed that agreement was high, particularly 
when the response was clearly classifiable in the normal par t-of -speech categories 
(noun, verb, adjective, adverb, other). Because of the very large volume of 
data (which could have totaled about 80,000 responses if all students wrote 
two sentences for each stimulus word) it was not considered worthwhile tx> 
institute reliability checks beyond those used in training the research 
assistants. In any case, the two research assistants who did the scoring 
frequently consulted each other to decide the coding of difficult cases. 

All data were keypunched and most of the analyses were done by a high- 
speed computer (IBM 360/65 ) through the use of specially written programs, 

RESULTS 

The major purpose of this experiment was to determine, by an objective 
method, the relative frequency with which a large number of words, 240 in 
all, were perceived in different parts of speech when these words were 
presented in isolation. Since a large number of respondents wrote two sentences 
for each word, and since in some cases data were obtained for a given word 
from two grade levels, the data were voluminous. Therefore, this report will 
restrict itself, in the main, to considering the data pooled over schools for 
a given grade level. No attempt is made to analyze the data for different 
schools within a grade level. 







Furthermore, the data obtained for i>5 eases for Level 1, grade 6 will be 
ignored because of the small frequencies available for each of the three 
forms . 

I acidence of v a lid, invalid, and no respons e s for "first sentence" resp o nses 

If all 1440 subjects in the designated groups had written at least one 
sentence for each word, there would have been 3 &, 45 £ responses in the 
"first sentence" posii 'on to score. Actually, over the total sample, only 
26,716 responses were written in the first sentence position, or 69 . 5 $ 
cf possible. The percentages for the different levels and grades were as 
follows: Level 1 , grade 3> 48. 5?>; Level 2, grade 6 , 76*8$, grade 9 . 7-1. 
level 3 , grade 9> 75 However, a considerable number of the respoiises were 

not considered valid for the purposes of this experiment. As shown in 
Table 4.2, there were small percentages of responses that were coded as A 
(ambiguous), C (capitalized), I (implicit transformations), Q (quotation 
forms), T (illegal transformations), and U (uninterpretable). Significant 
jercentages of responses, ranging from 1.6 to 8.4 depending on the level, form, 
end grade, were coded as R (not recognized in the proper sense). 

Only responses scored as representing clear and legitimate n r .he 
w :>rds as nouns, verbs, adjectives, or other parts of speech were considet'ed 
valid. The percentages of "valid" responses at the different levels and grades 
were as follows: Level 1, grade 3 , 39*1$; Level 2, grade 6, 66.2$, grade 9, 

(7*6$; Level 3 , grade 9, 70.7$* The variation in these percentages reflects 

t 

I’l) the varying difficulties of the words Included at the several levels, 

.2) the average ability levels at the severed grades, and ( 3 ) possibly, but 
probably to a limited extent, lack of eomp.irability of the samples with 
respect to ability or motivational levels. To the extent possible, the subjects 
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Table 4.2 



Percentages of Valid, Invalid, and Nc Response, 
by Level, Form, end Grades 











Percentages of all 


responses ( 1 st sentence) 




Form 


Grade 


Total 

N 


No 

Response 


A 


c 


I 


Q 


R 


T 


u 


Valid 


A 


3 


102 


48.8 


0.6 


1.3 


0.0 


0.1 


3.8 


0.5 


1.2 


43.5 


B 


3 


a.02 


53.1 


0.5 


0.6 


0.2 


0.8 


7.6 


0.7 


2.0 


34.5 


C 


3 


98 


52.6 


(5.5 


0_.T 


0.3 


0.6 


2.8 


0.4 


2.7 




All 


3 


302 


51. r 


0.5 


0.9 


0.2 


0.5 


4.7 


0.5 


2.0 


39-1 


A 


6 


126 


20.9 


0.2 


0.4 


0.1 


1.3 


5-5 


0.8 


0.9 


69.8 




9 


102 


29.2 


0.3 


0.2 


0.2 


0.1 


1.7 


0.7 


0,2 


67.4 


B 


6 


ibl 


22.9 


0.3 


0.8 


0.2 


0.8 


7.2 


0.4 


0.4 


56.9 




9 


106 


21.8 


0.2 


0.9 


0.1 


0.2 


2.6 


0.7 


0.2 


73-2 


C 


6 


138 


23.5 


0.4 


0.!5 


0.4 


1.2 


8.4 


0.7 


0.6 


62.3 




9 


97 


33.9 


0.1 


0.1 


0.1 


0.1 


3JL_ 


- 0 , 9 - 


0.1 


Si. 6 


All 


6 


1+05 


23.2 


0.3 


0.6 


0.3 


1.1 


7-1 


0.6 


0.6 


66.2 




9 


305 


28.1 


0.2 


0.4 


0.1 


0.1 


2.5 


0.8 


0.2 


67.6 


A 


9 


ll+3 


18.0 


0.2 


2.2 


o.c 


0.1 


1.6 


1.0 


0.1 


76.7 


B ■ 


9 


147 


31.2 


0.2 


0.7 


0.1 


0.2 


3-3 


0.4 


0.3 


63.6 


c 


9 


138 


22.9 


0.4 


. O.t 


0.3 


0.6 


2.2 


0.8 


0.1 


72.0 


An 


9 


428 


24.1 


9.3 


1.2 


0.1 


0.3 


2.4 


0.8 


0.2 


70.7 



Total No. of 


Responses 


Scorod 


L (1st sentence only) 


Level 1 


Grade 3: 


3953 


( 48. 556 of possible) 


2 


Grade 6 : 


8402 


( 76 . 8 $ of possible) 


2 


Grade 9: 


5917 


( 71 . 9 % of possible) 


3 


Grade 9s 


8444 


(75.9$ of possible) 






26716 


( 69 . 5 $ of possible) 
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had been given enough time to complete their forms , but the resalts suggest 
that many did not put enough effort into completing the forms properly. It 
is somewhat surprising that the results in Table 4.2 do not show a greater 
contrast than one might expect between the performances of grades 6 and 9 
at bevel 2, o. indeed between Levels 2 and 3 av grade 9» No explanation 
for this fact suggests itself immediately, 

It is apparent that the words included at Level 1 for grade 3 tended 
to be somewhat more difficult for the children to use in sentences than was 
expected. It is probable that overall, the grade 3 samples used in this 
experiment were of a lover average ability level then the rather select 
samples used at grade 3 in the previous experiment. The words included for 
Levels 2 and 3, on the other hand, were, apparently, approximately of the 
difficulty expected, with valid responses averaging around 65 to 70 percent, 

V, T e nay proceed immediately to a consideration of the results for the 
individual words, which are tabulated in Table 4.3* Table 4.3, in fact, 
presents a summary of most 01 the relevant data of the experiment, along with 
inforaati on on the level, form, and item number of the word, the word number 
as assigned in Appendix A, the word, the sample from which the word was 
drawn (S), the Dale rating (D), ohe Thorndike frequency-i’ank index (TH), 
the grammatical code (CC), the semantic code (SK), and the MCF vector. 

Various aspects of these data will be discussed in remaining sections of 
this chapter. 

Here let us consider the wide variation among the words with respect to 
the percentages of valid responses in the first sentence position. These 
percentages may be taken, with some qualifications, as indices of the difficulty 
that the respondents had in properly using each word in a sentence. (The 
major qualification is that xt could be argued that some of the "nonvalid" 
responses were in fact "proper" uses of the vor 1, particularly those coded ns 
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A [ambiguous], and C [capitalized]. Nevertheless, responses coded as A or 
C were relatively infrequent; the code C occurred with significant frequencies 
(ten or greater) only for the following; words: TOTAL. MISS, ROYAL, REVEREND, 

LINK, BUFFALO, PIKE, DIAL, HONEYCOMB, and NORTHEAST. 

It would not be particularly rewarding to study the variation in percentages 
of valid responses as a function of Thorndike frequency-rank Indices because 
these indices are relatively homogeneous within levels. It is useful, however, 
to examine this variation in relation to Dale ratings. A summarization of 
relevant data is given in Table h.h : where it will be seen that media n 
proportions of valid responses tend to be highly related to tne Dale ratings. 
Nevertheless, the proportions for given values of Dale ratings vary widely. 

It may be concluded that the Dale ratings give only limited indication as to 
whether children at a given grade will be successful, on the average, in 
using a given word in a sentence. 

Because the same words (in Level 2 forms) were given to samples at both 
grades 6 and 9. if is possible to study the relationship between the proportions 
of valid responses for these words at these grade levels. The Fearsonian 
correlation between these sets of proportions i6 .63; however, the scatterplot 
(figure 4.l) of the points reveals a most peculiar form of relationship. 

The majority of the points are in the upper right quadrant and are not very 
far from the line of equivalence; the deviations can be taken to represent 
largely sampling error. A few words with relatively high proportion of 
valid responses at grade 6 actually show a considerable decrement at the 91 b 
grade: FIST, HUT, RICE, MOTOR, DRUNK. The words AFFECT, TRIUMPH, REVEREND, 

and ROVE show low proportions at both grade levels. On the other hand, a 
considerable number of words shows very substantial (and statistic ally significant, 
O e 1# level) increases in proportions of valid responses over the two 
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grade levels; INDIVIDUAL, MATURE, QUIVER, MORAL, SOLITARY, ACKNOWLEDGE, 
MOTIVE, ATTIRE, POLL, LIBERAL, INCENSE, REVEREND, and ROVE. This suggests 
that most of the vords that caused trouble at the 6th grade were much better 
known by the 9tn grade students. 

Empirical data on part-of-speech use, "first sentence written ' 1 

In Table 4.3, the columns headed P(N), P(V), ?(a), and P(OT) slow, 
respectively, the proportions with which each word was used as a noun , 
as a verb, as an adjective, or as some other part of speech ir the first 
sentence written for the word. In every case, the base for these proportions 
is indicated in the column headed BASE N, this is the number of "valid 
responses" as defined in the preceding section, (^e meaning of the asterisks 
attached to some of the proportions will be explained below.) 

There were few instances in which the words were used as parts of speech 
other than noun, verb, or adjective. The only significant proportions 
occur for BETTER (.182) and for NORTHEAST (.255) Tor use as adverbs* 

A certain mathematical transformation of the proportions makes it 
possible to represent graphically the relative uses of the words as nouns, 
verbs, or adjectives?* The resulting plots are shown in Figures 4.2a-d. Vords 
used solely as nouns, verbs, or adjectives are to be found at the corners of 
the spherical triangle ) words used in various proportions c s either of two 



First, any proportions for "other 11 parts of speech are ignered; :*■ 

the proportions for N, V, and A are normalized so that they total unity 
Then the square roGts of these normalized proportions are computed as 
constituting a three-element row vector* The coordinates of the corresponding 
point in a unit circle are then found by multiplying this vector by the matrix: 

- /“ 75~-.5 

/TrT -.5 

0 1.0 

This transformation produces a perspective projection of a right spherical 
triangle onto a plane. 
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parts of speech are to be found along the sides of the triangle, placed so 
as to indicate the relative proportions; words used in some proportion in all 
three parts of speech are to be found in the interior of the figure. (All 
points are to be considered as being on the surface of a sphere.) 

Inspection of these figures makes it possible readily to identify words 
that are usually perceived in one part of speech and relatively seldom perceived 
in another part of speech, or in fact, to identify words that are about equally 
often used in two parts of speech. A word that is used equally often in three 
parts of speech would appear in the exact center of the figure; a word that is used 
equally Ox'ten in two parts of speech (but never in a third) would appear on the side 
o ? the figure halfway between the corners representing the two parts of speech. 

In the figures, words for which the pi'oportions are based on fewer than 
30 cases are enclosed in parentheses. 

As expected, the majority of words are of the NY type in terms of children's 
use or them in sentences; these words are represented along the bottom side 
of each figure. Fewer words are of the NA type, and fewer still are of the 
VA or NVA types. 

The data suggest that with inc ceasing grade level, words tend to be 
used in a greater number of grammatical functions. At grade 3, 20 of the 
8l words are used only in a single grammatical function. At grade 6, only 
12 of the 8l words in Level 2 forms are used in a single grammatical 
function, whereas at grade 9, only 8 of these same words are so used. Of 
the 78 words in the Level 3 forms, only 8 are used in a single grammatical 
function, furthermore, there is evidence from the comparison of grade 6 and 
grade 9 davn at Level 2 ttet MGF words tend to have a more even distribution 
among grammatical functions at the upper grade level. If ve consider only 
Level 2 words tint occur solely in the same two grammatical functions 
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Figure k.2 

Graphical Representation of Relative Proportions With ,/hlch Words Were Used as 
Nouns, Verbs, or Adjectives in a Sentence Construction Task, 
at Level 1, Grade 3 (a). Level 2, Grade 6 (b), level 2, Grade 9 (c), and Level 3, Grade 9 (d). 




(*) 



O 

ERIC 



LEVEL 2, GR.6 



uifV 

iuTutr 



815 



-77* 



Figure 4.2 (cont.) 
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Figure 4,2 (cent.) 
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Figure 4.2 (cont.) 
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at “both grades 6 and 9 } 44 out of 64 of the differences between the two proportions 

are smaller at grade p than at grade 6; v> < .001. That is, the words tend 

to approach an even split (.5 - .5) more at grade 9 than at grade 6. 

One of the major purposes of this pilot experiment was to identify 
"unusual" grammatical functions of words, i.e., the parts of speech in which 
words are seldom perceived. A purely statistical approach was taken at this 
point. It was decided that an "unusual" grammatical function would be or? for 
which the true probability of occurrence vas .2 or less. On the basis of 
sample data, of course, are could only estimate such a true probability 
within certain confidence levels. It was further decided, therefore, that 
for the purposes of the study, an "unusual" grammatical function would be one 

for which there was 95$ confidence that the true probability was no greater 

than .2 . Wilks (l 9 ^ 9 , equation 10, 18 ) gives the quadratic equation for the 
confidence limits of p for a confidence coefficient a : 

p 2 (n 2 + nz 2 ) - p (2nX + nz 2 ) + X 2 = 0 

where n = the size of the sample, 

p = a confidence limit for the true probability, 

z = the normal deviate corresponding to the confidence coefficient, 

X = th number of "successes," 

In the present case we wish to establish that an observed proportion, 

P q , is such that it is equal to or less than that proportion, p, that yields 
an upper confidence limit, p, equal to .2 . Since p ~ X/n, we may substitute 
np — X in the above equation, and solve for p as a function of n and p. 

This gives: 

A- L ’ t &* + C = 0, 
p r ' 



o 
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where A — n 



2 





2 

'a • 



Solving for p , we have: 



p = (-B - / B 2 - 4AC ) / 2A. 



Since we are concerned only with one tail of the distribution, the confidence 
coefficient a = .95 corresponds to z a = 1.64 . To see whether an observed 
proportion has an upper 95 1 ° confidence limit no greater than *2, we need only 
determine whether p Q is equal to or less than the value of p yielded by the 
above equation. 

The asterisks given immediately to the left of proportions in Table 4,3 
indicate that the proportion yields an upper confidence limit no greater than 
,2 at the 95 $ confidence level. Since the formula takes the base n into 
account, asterisks do not in general occur for small base n’s. Of course, 
in many instances asterisks occur for proportions equal to zero, but these may 
often be discounted because the grammatical function in question would not, 
in fact, ever occur. For example, the empirical proportion for BALANCE as 
an adjective (Level 1, grade 3 ) was .000, and in fact we would not expect 
BALANCE to occur as an adjective. An "unusual" grammatical function would be 
one that occurs with greater than zero frequency but with an upper confidence 
limit as specified above. For example, according to our data, BROKE (Level 
1, grade 3 ) was used as an adjective with a proportion of only .111, and 
according to the criterion specified, this 3s "unusual"; therefore it receives 
asterisk in Table 4.3. 
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These results concerning '’unusual" grammatical functions of words were 
employed in selecting words for the main experiment, to he described in 
Chapter V. 

Comparison of MGF vectors with the empirical "first sentence 11 data 

To determine whether the MGF vectors estimated by methods described in 
Chapter II were good estimates of the empirical proportions with which the 
words were used in the first sentences written for each word, the highest 
MGF vector component for each word was compared with the corresponding 
empirical proportion. This analysis, of course, was carried out only for 
MGF words; thus, the "highest" MGF vector component was at most 9 * 

However, when a value of 9 for one part of speech was accompanied by a value 
of "--i" in the MGF vector for another part of speech (denoting a proportion 
vanishingly close to zero), it was considered separately, as if it were 9+ • 

In case of tied elements of 5 and 5, the corresponding empirical proportion 
was alvays that which corresponded to the first occurrence of 5 in the order 
N - V - A. For example, for an MGF vector (0 5 5) the corresponding empirical 
proportion was that for the verb. Table 4.5 shows the mean and S. D, of the 
empirical proportions for each value of the highest MGF vector component, 
for the data at each combimtion of level and grade. To assure a reasonable 
degree of reliability in the empirical propoxtions, only data for words 
validly responded to by at least 20 Ss were included. An analysis of 
variance was applied to determine the significance of the relationship. As 
may be seen, the relationship was highly significant at each level and grade. 
Also, the mean proportions roughly correspond to the MGF values. If the 
prediction had been ideal, the mean empirical proportion corresponding, eay, 

to an MGF value of 6 would be .600, with no variance. The prediction was, 

0 

ourse, far from this ideal case. Inspection of Table 4.3 vill reveal 
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Table 4.5 



Means and Standard. Deviations of Einpirical NVA Proportions (1st Sentence) 
Corresponding to Each Value of the Highest MGF Vector Component, for Each 
Combination of Level and Grade, with Analysis of Variance Results 



Highest MG 
Vector 
Component 


V 


Level 

Grade 


1 

3 




Level 2 
Grade 6 






Level 2 
Grade 9 






Level ; 
Grade < 


3 

? 


n 


X 


0 


n 


X 


0 


n 


X 


O 


n 


X 


a 


4,5 


4 


.564 


.223 


'9 


.441 


.378 


9 


.488 


.321 


4 


.454 


.126 


6 


5 


.466 


.191 


8 


.469 


.316 


8 


.424 


.179 


10 


.576 


.228 


7 


11 


.856 


.073 


l4 


.691 


.233 


l4 


.719 


.173 


10 


.709 


.230 


8 


14 


• 772 


.314 


12 


• 783 


.219 


12 


.757 


.223 


11 


.818 


.163 


9 


22 


.910 


.168 


24 


.841 


.219 


23 


.809 


.176 


26 


.793 


.247 


91- 


7 


• 973 


.034 


13 


.863 


.278 


l4 


.893 


.249 


16 


.851 


.245 


Total 


63 


.820 


.243 


80 


.728 


.305 


80 


• 725 


.264 


77 


.752 


.252 


F 




5.934 






4.975 






7-043 






3.345 




d.f.. 




5 






5 






5 






5 




<l.f. 2 




57 






74 






74 






71 




P 




<.001 






<.001 






<.001 






<.01 




i 




.585 






.502 






.568 






.437 





o 
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many cases where the empirical ‘'first sentence" proportions are quite different 
from those that vould he estimated from the KJF vectors. 

Among words expected to be most frequently -used as nouns , the following 
veie more often used as verbs: COPT, GLANCE, TRADE, ARREST, RESERVE, SHIRT, 

BIAS, DIAL, FRAY, LOAN, and VOLUNTEER. More often used as adjectives were 
STANDARD, CHOCOLATE, INDIVIDUAL, EXPEDIENT, and ZERO. 

Among words expected to be most frequently used as verbs, the following 
were more often used as nouns: INCENSE, LINK, STAIN, CHISEL, FOIL, HUDDLE, 

SCOOP, and STROLL. More often used as adjectives were SECURE, MATURE, and 
SPA]ffi, 

Among words expected to be most frequently used as ad jectives , the 
following were more often used as nouns: GENERAL, SAVAGE, TOTAL, EIDER, 

MORAL, and NORTHEAST. More often used as verbs were SEPARATE, GRADUATE, and 
LIMP. 

As was pointed out in Chapter II, the IGF vectors vez'e estimated on the 
basis of very meager frequency data. Furthermore , these frequency data, 
limited as they are, were mainly derived from adult literature. Nevertheless, 
the KGF vectors may very well be valid as es t imates of frequency in adult 
literature . They should not necessarily be expected to agree with the 
nonnative data collected here on children's grammatical perceptions, which we 
may assume are a function of the frequer.rle > with which the various parts 
of speech occur in children’s experience, either in spoken or written language, 
or both. V. r e have no satisfactory vey of estimating such frequencies directly. 
Possibly the present normative data can be lonsidered indirect estimates of 
the frequencies, if one accepts the "spew hypothesis” advanced by Underwood 
and Schulz (i960, p. 86) to the effect that 'the order cf availability of 
verbal units is directly related to the frequency with which the units have 
been experienced.” In any case, the present normative data nre believed to 
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be useful as direct indications of children's grammatical perceptions of 
words presented in isolation. 

It should he noted that the relations between the MGF vectors and the 
empirical proportions are approximately of the same magnitude at each level 
and grade. Thus, there is in general no evidence that the results obtained 
at the higher grades approach those predicted by the MGF vectors more 
closely than at the lower grades. Through the comparison of proportions for 
Level 2 words at grades 6 and 9 , one can find a few isolated cases in which 
the grade 9 proportions seem to approximate the MGF vector predictions more 
closely than the grade 6 proportions do. For example, at grade 6 only 38.5$ 
used INDIVIDUAL (MGF vector 7 0 3) as a nouri, whereas at grade 9 the percentage 
was .677 . Similarly, MORAL (MGF vector 1 0 9 ) vas used as an adjective at 
grade 6 by only 13.0$ but at grade 9 by 33 * 3 $ * For these words, the results 
suggest that older children are more likely to use them in "adult” grammatical 
functions. 

Reliability of the empirical MGF proportions 

The reliability of the empirical MGF proportions presented in Table 4.3 
is to some extent a function of the numbers of cases on which they are based. 
For some words, especially at the lover grades, the N'e on which the propor- 
tions are based are relatively small due to the fact that large numbers of 
respondents failed to give valid responses bo these words. The reliability of 
the data is also a function of the unknown extent to which the samples are 
representative of the populations (grades 3 , 6, and 9 school-children in the 
U. S.) which they were supposed to represent. 

The available data permit the use of two methods of further assessing 
their reliability: (l) comparisons of data from different grades, arri (2) 

o 

|i. irison with data obtained on certain words in t he pilot study. 
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Comparison of data between grades is possible only for vords in the 
Level 2 forms. For each of these 8l vords, the highest proportion in 
the empirical MGF vector at grade 6 was compared with the corresponding 
proportion at grade 9 by means of a chi-squared test with Id. f. One 
would expect, by chance, about 4 of these comparisons to be significant at 
the % level; actually, 23 of them were. Also, by chance only about one 
comparison would be significant at the Vjo level; actually, 15 of them were. 

For present purposes, it is probably wise to use the 1$ significance level as 
a criterion for selecting vords with probable true differences. On this 
basis, 64 of the 8l comparisons may be regarded as not significant; this 
result seems to testify to the general stability of the data across grades. 

The 15 vords for ^vhich differences were significant at the 1$ level are as 
follows: APPEAL, ATTIRE, CHANNEL, DIP, DOCK, DRUG, ESTIMATE, RADUATE, HUM, 
JND1YIDUAL, KNOT, STAIN, SWAMP, UNIFORM, aid WAX. The relevant data may be 
found in Table 4.3* In general, the differencer are In the direction of 
less concentration on a given part of speech in grade 9 than in grade 6. 

A similar series of tests of significance was- then carried out for the 
3 6 words that were common to the pilot study and the present normative study. 
For the 9 vords at Level 1 (Level I of the pilot study), comparisons wer': made 
both at grade 3 and at grade 6 (using data that are not presented in Table 4.3 
because cf small N's). Only one of these vords, INSTANT, showed e difference 
significant at the level; the empirical MGF proportions were (.478, .0, 
•522; N=67) for the pilot experiment and (.857, .0, .143; H-14) for the 
normative study data. For the 9 words at Level 2 (Level II of the pilot 
study), comparisons were possible for both grides 6 and 9. Four vords, DIP, 
INDIVIDUAL, SCREEN, end WAX, shoved significant differences at grade 6, 
and SCREEN and VAX also shoved significant differences at grade 9- (The 
relevant data r. ;y be found in Tables 3*5 and 4.3.) It is possible, he-; ever, 



that these differences may he partly due to changes in coding practices 
between the two studies, particularly in the case of SCREEN, which, when 
used as an attributive adjective as in screen door i may have been more often 
coded as a noun in the normative study than in the pilot study. 

For the 18 words at Level 3 (Levels III and IV in the pilot study), 
comparisons were possible only for grade 9 , Of these words, only 3 showed 
significant differences: ANIMATE, CARDINAL, and RADICAL, Again, the 
relevant proportions may be found In Tables 3.5 and 4,3 . 

To conclude: while small numbers of words showed significant differences 

either between grades or between studies, the majority of words yielded MGF 
proportions that are reasonably stable between grades and between studies. 

In cidence of s econd sentences and of changes of grammatical function in the 
second sentences written for each word 

The last three columns of Table 4,3 give three proportions for each word: 

P(2): Probability of writing a second sentence, vhether "valid" 

or not. The base of this proportion is BAS*' N. 

P(VAL. 2ND R); Probability oC writing a valid second sentence, l.e., 

* with a legitimate part of speech for the word. Again, the base of 

this proportion is BASE N. 

P(GRAM. CHANGE): The probability that, if a valid second sentence 

was written, it contained the word in a pai c of speech other than 
that in which it was used in the first sentence written. The 
base for this proportion is the number of valid second responses 
[={BASE N)* (P(VAL. 2ND R))]. 

These values permit one to study the degree to which there was a tendency 
to write a second sentence for a word and to use the word in a different y> art 
O speech in such a sentence. It will be recalled that the instructions for 
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this test asked the respondents to write "the first sentence that you think 
of M and then "another sentence using the word in a different way." It was 
hoped that these instructions would often dispose the respondent to use the 
word in a different part of speech. Of course, many words were semantically 
ambiguous and could be used "in a different way" even without a change in 
grammatical function. In any case, it was believed that the extent to which 
"second sentences" were written with a change of grammatical function would 
indicate the extent to which the respondents were familiar with the multiple 
grammatical functions of the words. 

Close exam L.iat ion of all the data suggested that it would be useful to 
derive a new variable, labelled T(PMA), namely, an arc sine transformation 
of the largest value in the empirical MGF vector for the first sentence 
written. This derivation suggested itself because it was noted that the 
words exhibiting the largest amount of grammatical change in the second 
sentence written tended to be words with relatively "balanced" empirical 
MGF vectors. That is, these were the words in which the proportions with 
which two grammatical functions were used approached .5 (or . 333 ^ for the 
case of If/A words with three grammatical functions). Conversely, words which 
tended to be used in a single grammatical function in the first sentence 
written, over the sample of responses, tended to be words for which +he 
probabilicy of grammatical change in the second sentence vp.s low. The 
magnitude of the largest element in the empirical KGF vector for the first 
sentence written was taken as an inverse index of the "balance'' of the 
vector. For example, au Level 2, grade 6, the word. SPARS nas a relatively 
"balanced" MGF vector ( .OoR, . 3ol , .>71) for the first sentence written and 
it was used in a different part of speech in 64.1^ of the valid second 
sentences written, whereas the word CHANNEL had an "unbalanced" empirical 
MGF vector (l.OOO, .0, .0) and was never used in a different part of speech 
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in a second valid sentence, even though 82.4$ of the respondents wrote 
"valid" second sentences. The largest element of the empirical MGF vector 
vas given the designation PMA (e.g., .571 for SFARE and 1.000 for CHANNEL). 

The arc sine transformation (2 arc sine vH?MA) was used because scatterplcts 
of the Joint distribution of PMA and P(GRAM. CHANGE) suggested that such a 
transformation would much improve the linearity of the relationship. 

Table 4.6 shows the correlations, over words with BASE N equal to 20 or 
greater, of the variables P(TOT), T(PMA), P(VALID 2ND R), and P(GRAM. CHANGE). 
It also shows the means and standard deviations of these variables as they 
distribute over the words, and the beta weights (3) and shrunken multiple 
correlations (r) in the prediction of p(GRAM. CHANGE) from the other three 
variables . 

First let it be observed that these fcur variables are experimentally 
independent in the sense that there are no constraints against their having 
zero correlations. The three proportions are based on different N r s, and 
T(FMA) can vary independently of any of these N's. 

It may then be Aoted, from Table 4.6, that: 

(a) There is a marked rice (F 0 = 28.92, p < »D0l) In mean P(TOT) 

di f 

over levels (and grades), part* ularly from Level 1 to Level 2. (The data 
for Level 2, grade 9 were excluded from this analysis because they are 
correlated with those from Level 2, grade 6. The nature of the data 

automatically results in a confounding of level ard grade.) T> - e ult, 

of course, applies to the first sentence written ani merely underlines the 
conclusion derived from Table 4.2, with the minor difference that the results 
here were derived only from words for which BASE N is 20 or greater. 

(b) There is a sli^it decline (F _ = 3-47/ p <«05) in mean T(PKA). 

C, d± I 

That is, the "balance" of the empirical vectors tends to increase with level 
(and presumably also with grade). (A t-test for correlated means for level 2 f 
ide 6 vs. 9 shews the diffeience to be significant , p <L00l) 

ML 



98 

-90- 



Table h.6 

Correlational Analysis of Four Variables Pertaining to 
Use of Different Grammatical Functions in First and 
Second Sentences Written for a Word* 





Level and 






P( VALID 


P(GRAM. 






Grade 


p'TOT) 


T(PMA) 


2ND F) 


CHANGE) 


e 


P(TOT) 


1-3 


1.000 


.01*9 


.730 


-.081 


-.225 




2-6 


1.000 


-.017 


* .786 


.181* 


.069 




2-9 


1.000 


-.367 


.506 


.300 


-.081* 




3-9 


1.000 


-.138 


■ 75 1 * 


.275 


.125 


T(PMA) 


1-3 


.01*9 


1.000 


. 001 * 


-.718 


-. 708 *** 




2-6 


-.017 


1.000 


-.311 


-.861 


-. 820 *** 




2-9 


-.'567 


1.000 


-. 611 * 


-.887 


-.811+*** 




3-9 


-.138 


1.000 


-.1(00 


-.872 


-. 836 *** 


P{ VALID 2ND R) 


1-3 


.730 


. 001 * 


1 .000 


.078 


.21*5 




2-6 


.786 


-.311 


1.000 


.1*38 


.128 




2-9 


.506 


-. 61 !* 


1.000 


.625 


. 168 * 




3-9 


• 75^ 


-. 1*00 


1.000 


.1*71* 


.015 


Means 


1-3 


.1*70 


2.560 


.615 


.161* n 


63 




2-6 


.670 


2. 1*1*9 


.656 


.280 


80 




2-9 


.680 


2 . 3’/ 


. 651 * 


.1*1*8 


60 




3-9 


.716 


2 . 350 


.628 


.1*15 


77 


S.D. 's 


1-3 


.195 


.1*1*8 


.121 


.151 K 


.734 




2-6 


.211* 


.1*68 


.151 


.205 


.879 




2-9 


.151. 


.1*77 


.172 


.253 


. 89 !* 




3-9 


.181* 


.1*78 


. 171 * 


.21*8 


.881* 


* Symbols : 


P(TOT) : 


Proportion 


of valid 


first sentence responses 


, based on 



total N, where N is the number of respondents. 
T(PMA): Arc 3ine trans forest ion of the largest element in the 

empirical MGF vector, and inverse index of the 
''balance” of the vector, or its distribution o/er 



ERIC 



parts of speech. 

Probability of a valid 2nd sentence, based on 
(BASK N) = U * P(TOT). 

Probability of a grammatical change in word function 
in the 2nd sentence written, based on (BASK if) * 

P (VALID 2ND R). 

Beta weight of variable in prediction of F(GRAMv CHANGE) 
fron the other three variables. 

Number of words on which calculations are based. 
"Shrunken” multiple correlation for prediction of 
P ( GRAM . CHANGE) from the three other variables. 

In the body of the table, *** means p <_ .001; * means p <_ .09. 



P( VALID 2ND R) : 
F ( GRAM . CHANGE): 

Bi 

ns 

B: 
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(c) Mean P(VALID 2ND R) is quite stable over levels (F^ = 1.37 n.s,), 

the overall mean being .63^ with nonsignificant variation over levels. (The 

g ade 6 vs. grade 9 difference is nonsignificant.) 

(d) There is a marked rise in P(GRAM. CHANGE) over levels (F^ 2 yj = 25.12,, 
p <.00l). Presumably this also applies over grades; the Level 2, grade 6 vs. 

9 difference is highly significant, p <.001. It is reasonable to infer that 
the tendency to change grammatical function in a second sentence increases 
over grades. 

(e) From the correlational analysis, it appears that the difficulty of 
a word, as indexed by P(TOT), is not significantly related to its tendency 
to elicit, a changed grammatical function in the second-sentence data. 

(f) A lai-ge proportion of the variance of P(GRAM. CHANGE) is associated 
with T{PMA), with highly significant correlations and beta weights. That is, 
for words at a given level and grade, as the "balance" of the MGF vector 
increases, there is an associated tendency for the respondents to use the 
word in a different part of speech in the second sentence written. Such a 
result might have been expected, for as the "balance" of the first sentence 
MGF vector increases, i.e,, as the probabilities for the different parts of 
speech in the first sentence become more equal, the respondents are more likely 
to be familiar with different grammatical functions of the words and hence 

to change grammatical functions when they write a second sentence illustrating 
a "different" use of the word. 

(g) Ihe tendency to write a valid second sentence is positively corre- 
lated with the tendency to change a word's grammatical function in so doing, 
particularly at the higher grades, but this tendency makes a significant 

(p <.05) independent contribution to the prediction of p(GRAM. CHANGE) 
over and above the prediction from T(FMA) only for one set of data — that for 
T rel 2, grade 9- 

ERIC 
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From the results discussed thus far, we may conclude that thv tendency 
to change grammatical function is chiefly associated with whether tne word 
is known in different parts of speech by the group. There is, however, 
another factor to be considered- -the polysemy (multiple meaning) of a word. 

The variation in P(GRAM. CHANGE) was thought to be possibly associated with 
the semantic coding (SM) of the word as explained in Chapter II. It will 
be recalled that a code of 1 was assigned to an MGF word when it contained 
one and only one basic meaning (e.g., the meaning of FILL as a noun and as a 
verb) throughout the two or three grammatical functions in which it might 
be used. Codes 2 , 3* or 4 were assigned when polysemy was associated, in 
one of several possible ways, with charges in grammatical function. It 
might be reasoned that respondents would be more likely to use a word in a 
different grammatical function in their second sentences when the i;enantic 
code was 2 , 3; or 4 than when it was 1, because they might regard « "different 
way" of using the word as one having to do with a different serse of the word. 
To investigate this possibility, the mean values of P(GRAM. CHANGE) were 
determined for each value of the semantic classification and analyses of 




variance were done to study the significance of variation in these means. 

The results are shown in Table 4.7. Because there were relatively few words 
in semantic code classifications 2 and 4, for the analyses of variance the 
data for these words were pooled with those for words with code 3* Further, 
the analyses were restricted to words for which BASF N (number of valid 
first sentences) was 20 or greater, in order to insure reasonable reliability 
in the basic data. The differences between words in semantic code 1 and words 
in semantic codes 2, 3 , ani 4 combined are all in the expected direction, but 
they are highly significant only at Level 2 , grade 6, tapering off to r.on- 
significanee at Level 3, grade 9 . These results suggest that polysemy is a 
significant factor in the use of grammatical change in second-sente/ice writing 
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Table 4.7 





Analysis 


of P(GRAM. CHANGE) by Semantic Code 






Level 1 


Level 


2 


Level 2 


Level 3 


Semantic 

Code 


Grade 3 


Grade 6 


Grade 9 


Grade 9 


n X 


n 


X 


n X 


n X 


1 


42 .139 


58 


.243 


58 . 406 


60 .408 


2 


1 .103 


2 


.495 


2 .659 


1 .500 


3 


11 .193 


IT 


.365 


17 .520 


11 . 420 


4 


9 .252 


3 


.388 


3 .721 


5 .471 


2, 3, 4 
Combined 


21 . 214 


22 


.380 


22 . 560 


17 .440 


Total 


63 .164 


80 


.280 


80 .448 


77 -415 


F 


3.545 


7.707 




6.291 


0.247 


a.f 


1 


1 




1 


1 




6l 


78 




78 


75 


P 


<.10 


<.01 




<.025 


n. a . 



O 
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(as defined in this experiment) only at grade 6. A possible interpretation 
of these results is that at grade 3 respondents are seldom avare of alter- 
native senses of words, but that at grade 6 they become more avare of them. 

By grade % students are often avare not only of polysemy but also of 
polysyntagmy (multiple grammatical function) even when polysemy is minimal. 
Polysemy i;3, however, an influential factor for grade 9 students only for the 
less difficult words, i.e., those in the Level 2 forms. 

fhis interpretation is supported by similar analyses of P(TOT), T(PKA), 
and P(VALID 2ND R), shown in Table 4 . 8 . Only at Level 2, grade 9 are 
polysemic words successfully u. c ed in the first sentence written significantly 

more often than nonpolysemic words. At Level 2, for both grade 6 and grade 9; 
polysemic words are significantly more often used in valid second sentences 
than the nonpolysemic words, but the differences are not significant for 
words in Level 3 forms. 



o 
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Table 4.8 

Means of Three Variables by Semantic Code Classifications 
■with Analysis of Variance Significance Tests 











Semant ic 
















Codes 


p(tot) 


T(PMA) 


P(VALID 2ND RESPONSE) 


Level 


i. 


Gr. 


3 


1 


.492 


2.635 


.627 










2,3,4 


.428 


2.412 


• 592 










F l,6l 


1.47 


3-55 


1.13 










P 


n. s. 


n.s. 


n.s. 


Level 


2, 


Gr. 


6 


1 


.647 


2.508 


.630 










2,3,4 


.73^ 


2.294 


.726 










F l,78 


2.68 


3.34 


6.87 










P 


n.s. 


n.s. 


<.025 


Level 


2, 


Gr. 


9 


1 


.650 


2.383 


.608 










2,3,4 


• 759 


2.l40 


.777 










F l,78 


8.71 


4.16 


18.55 










P 


<.01 


<.05 


<.001 


Level 


3, 


Gr. 


9 


1 


• 731 


2.380 


.625 










2,3^ 


.660 


2.251 


.640 










7 ? 

1,75 


2.03 


< 1 


< 1 










P 


n.s. 


n.s . 


n.s. 



o 
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Chapter V 



Children’s Comprehension of MOF Words 



Introduction 

With the compilation of the data on children's grammatical responses 
to KGF words reported in Chapter IV, it ‘became possible to undertake the 
study which had been the principal goal of this project, namely, a study 
to compare children's comprehension of words used in their ’’usual” or 
"most potent" grammatical functions with their comprehension of these 
same words when used in "unusual tr or "less potent" grammatical functions. 

It was believed that, at least at the lever grades, children would comprehend 
MGF words less well in their less common grammatical functions than in 
their more common grammatical functions. 

This chapter describes the design and outcomes of the large-scale 
study that was performed to obtain data bearing on this question. 

Selection of words to be included in t h e test instruments 

Since this study had the objective of seeing how well children 
comprehend unusual grammatical uses :>f words, it was necessary to sel-. 
a list of words for which at least one grammatical usage had a low 
probability in the normative data collected in the earlier phases of t.*..v 
study. Ac described in Chapter IV, statistical procedures were appiie' 
to identify gramnat ica 1 functions of words such that the true prooubilUivs 
of those grammatical functions, as reflected in the first sentence vr’tcan 
in response to a word, would be less then .2 at the confide: ee level. 
Those functions are identified by asterisks in Table ^-3* however, uhe 
asterisks printed next to zero or near zeto probabilities for "ill c-gi t Lu .to” 
grci-imatical uses of the words are to be discounted. 
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The overall design of the study and practical considerations in the 
construction of the instruments to be used for testing comprehension 
permitted the use of only a relatively small sample of MGF words — to be 
exact, 21 words at each of thre . levels of difficulty in terms of Thorndike 
rank- frequency indices. 

If words had been selected solely on the criterion that the normative 
data showed estimated true probabilities of "unusual" grammatical functions 
to be less than .2, it would have been possible to select a total of 132 
words (55$) of the 240 MGF words in the normative data: 46 (57$) °f the 
8l words at Level 1, 49 (60$) of the 8l words at Level 2, and 37 (47$) of 
the 7 8 words at Level 3« These results are based on the use of grade 3 
normative data for Level 1 words, grade 6 normative data for Level 2 words, 
and grade 9 normative data for Level 3 words. (Generally, the normative 
data from grade 6 for Level 1 words, though meager, and the voluminous data 
f^om grade 9 for Level 2 words confirm these results.) 

Various other c ons id e rat lexis were used In the final selection of 21 
words at eacr level. Some of the "unusual" grammatical usages that were 
identified by the statistical criterion were extremely rare or archaic (e.g. 
ACKNOWLEDGE as a noun) and it was judged that children would not be expected 
to know these usages. On the other hand, some usages, though unusual in 
the grammatical perceptions of the children, were judged to be so common 
in actual frequer. :y that they would be well within children's comprehension, 
e.g., JUMP as a noun. Some examples of such "unusual" but "common" usages 
were included in the selected words, however, e.g., END, FREE, and NAME 
as verbs. One other consideration in the selection of words was that the 
final sample should include examples of words in various "semantic codes" 

(as described in Chapter I I ) , i.e.. both words in semantic code "l" where 
same one basic meaning was present in two or more grammtical functions, 
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and vords In semantic codes ”2," "3," and "4’ 1 exhibiting various types of 
polysemy across grammatical functions. 

The 63 words finally selected for the study are shown in Table 5.1 
along with various other information concerning them. 

As a matter of record, we list the words that might have been selected 
but were not, for various reasons. In the following lists, the "unusual" 
grammatical functions are indicated; the corresponding proportions from 
the normative data may be found in Table 4.3: 

Level 1: BABY (v.), DECK (v.), DIVIDE (n.), FEVER (v.), BETTER (v.), 

HIRE (n.), JUMP (n.), KICK (n.), LEFT (n.), MAP (v.), MINUTE (adj.). 

NATIONAL (n.), NINE (n.), NOISE (v.), PICK (n.), PUBLIC (n.), ROYAL (n.), 

RUN (n.), SEPARATE (adj.), SLOPE (v.), STAR (v.), STIR (n.), TOTAL (v.), 

TRADE (n.), WARM (v.). 

Level 2: ACKNOWLEDGE (n.), AFFECT (n.), ASSOCIATE (adj.), CAREER (v.), 

CELL (v.), CHAPTER (v.), DRUNK (n.), FIST (v.), GIRDIE (v.), GRADUATE (adj.), 
HUT (v.), JAW (v.), JOB (v.), LAST (v.), MAJOR (v.), MIST (v.), MOTIVE (adj.), 
OFFICER (v.), PARTNER (v.), RESERVE (n., adj.), RICE (v.), ROVE (n.), 

SCREEN (v., adj.), SNATCH (n.), SPIT (n.), TENTH (n.), UNIFORM (adj.). 

Level 3: CARDINAL (adj.), COSTUME (v.), CROUCH (n.), DIZZY (v.), 

EXPEDIENT (n.), HONEYCOMB (v.), PIKE (v.), PROPOSITION (v.), PYRAMID (v.), 
SCISSOR (v.), SOCKET (v.), SUSPICION (v.), TRANCE (v.), UPSET (n.), VULGAR (n.), 
ZERO (v.). 

Construction and design of instruments for testing comprehension of MG F vords 
In the original project plan, four types of instruments for testing 
children's comprehension of MGF vords were proposed; 

(l) Multiple-cho i ce vocabulary tests . Children would he presented with 




words in context, some exhibiting frequent grammatical functions, others 
exhibiting infrequent grammatical functions, and asked to identify the 
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meanings by matching them with synonyms or words that are closely related 
semantically . 

(2) "Headline" tests . Tn order to restrict grammatical cues somewhat, 
imaginary newspaper headlines would be presented and the pupils would be 
asked to expand or paraphrase these. Alternate forms of the test would 
present words in frequent and in infrequent grammatical functions. 

(3) Sentence evalvTa tio n tests . Alternate forms of this test would present 
(l) sentences containing frequent grammatical functions for a word, (2) sentences 
containing infrequent grammatical functions, and ( 3 ) sentences containing 
clearly unacceptable (syntactically anomalous) usages of the MGF words. The 
respondents would be asked to evaluate each sentence for "correctness" or 
acceptability. 

(t) Verification tests . It was thought that at least some MGF words 
might lend theLselves to the construction of instruments that would test 
comprehension by asking the respondent to match a sentence with one of four 
pictures, sentences such that if they contained a MGF-H usage they would 
refer to cr.e of the pictures vvereas if they contained a MGF-L usage they 
would refer to another of the pictuies. 

Attempts were made to construct suitable tests of all four types, bit 
it was found that the two most practicable types of tests were (2) and (3)j 
the "headlines" test and the sentence evaluation test. 

Although it might have seemed easy to construct appropriate multiple- 
choice vocabulary tests, this proved to be untrue. The difficulty was 
that in the context of the present experiment it was usually impossible to 
avoid constructing alternative choices that did not T 'give away" the grammatical 
function of the key word. 

After sore investigation, the plan to construct "verification" tests 



o 



was abandoned because fw MGF words lent themselves to easy pictorial 
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representation. In any case, the cost and difficulty of laving suitable 
pictures dravn vas thought to make this plan impracticable. 

Sentence evaluation tests . It proved relatively easy to construct this 
type of test. The type of item may be illustrated by the items constructed 
for "frequent" (MGF-H), "infrequent 11 (MGF-L), and anomalous usages of the 
word AGE, selected at Level 1. 



MGF ; : 


(Noun) 


He told me his age. 


RIGHT 


WRONG 


MGF-L: 


(Verb) 


The trees age every year. 


RIGHT 


WRONG 


(Anom. ) 




The age paper was new. 


RIGHT 


WRONG 



The respondent vas asked to decide whether the underlined word is used correctly 
or not, and to put a circle around RIGHT or WRONG to indicate his decision. 

At each level of difficulty, three alternate forms were constructed to 
test the 21 words chosen for that level. The MGF-H, MGF-L, and anomalous 
usages were randomly distributed among the three forms, with the constraint 
that each form would contain 7 MGF-H items, 7 MGF-L Items, and 7 anomalous items/ 
A respondent correctly marking each Item would mark 14 items as RIGHT and 7 '.icms 
as WRONG. Nothing vas indicated in the instructions as to how many items would 
be correctly marked as RIGHT or WRONG. The 7 anomalous items served as "filler 11 
Items to provide an opportunity for the respondent to find "WRONG" items. The 
test vas designed so that it vould be possible to compare the responses to 
MGF-H and MGF-L items when the different forms were administered to random 
divisions of the school classes to be tested 

The page of test items vas preceded by a page of instructions which stated 
that "this is a test of how well you know the uses of certain words" and 
illustrated, the manner of marking the responses for two sentences with 
"correct" usages and one sentence with an anomalous usage. The respondents 

Vnrough a clerical error, a minor deviation from th^s rule occurred for 
the Level 2 forms. The "H" and "L" usages of TWINE were placed In Forms C 
q* A, respectively, whereas they should have been put in Forms A and C, respec- 

ERJC 1y ' 
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vere cautioned that the test "lias nothing to do with whether the sentences 
are true or not," and were given three further practice items (again, two 
"right" and one "wrong"). 

Headlines test . For this test, it was necessary to construct imagirmy 
"headlines" illustrating the MGF-H and MGF-L usages. The type of item may 
be illustrated, as before, for the word AGE: 

MGF-H: 

CHILD TELLS HIS AGE 



MGF-L: 

STUDY SHOWS PEOPLE AGE SLOWER 



For each item, two lines were provided which the respondent could use to 
write a paraphrase that would "explain what the headline means" without 
using the underlined word. 

Two alternate forms were constructed at each level, the MGF-H and 
MGF-L usages being assigned randomly to the two forms under the constraint 

p 

that 10 or 11 of each type would occur in each form. Formating considerations 
dictated that each form contained a total of 21 items, 7 items on each of 
three pages. The cover page contained instructions which stated that this 
was "a test of how well you und erst end newspaper headlines," and gave a 
number of examples of how the test was to be completed — h examples completed 
and 2 for the respondent to try for himself. 

Ml the items in both the sentence evaluation test and the headlines 
test, in their several versions for each word, are presented in Appendix D. 

^ Through clerical error, Form A at Level 3 contained 12 H and 9 D, uhile 
Form B contained g H end 12 L, because the H ard L usages of WJBBM were 
missssignei . . . * ( 
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It. could be argued that the results of this study would be determined, 
to some extent, by the particular sentences constructed for the words and 
that in consequence the results could not readily be generalized to other 
sentences that might be written for the words. The only defense against 
this argument is that the major purpose was to generalize certain conclusions 
over £ >unples of words rather than to study performance on particular words. 
Any confounding of results with the particularities of item construction 
would, it was hoped, bo approximately randomized over the samples of words, 

It would have been impra^ ''able, without greatly increasing the scale of 
the study, to construct alternate sets of sentences for the words in order 
to test the hypothesis of interaction between particular item contexts and 
the ’’treatment 11 effect represented by MGF-H, MGF-L, and anomalous usages, 

In any case, a partial remedy for this design problem was provided by the 
fact that each word was used both in a set of ,r sentence evaluation tests" 
and in a set of "headlines" tests, with the consequent possibility of 
comparing results across the two types of test. 

Vocabulary test . Within the limited testing time available for this 
study, it was considered desirable to obtain a measure of general verbal 
ability for each child in order to have a basis for comparing groups and 
analyzing results of the sentence evaluation and headlines test. This had 
to be a brief test, and at the same time it needed to have such a range of 
difficulty that it would be equally appropriate for children in grades 3, 6, 
and 9- After a survey of the possibilities, it was decided to make an 
adaptation of the Wide Range Vocabulary Test , Form B, by C. R. Atwell and 
F. L. Wells, published and copyrighted by The Psychological Corporation. 

With the special permission of The Psychological Corporation, 25 items from 
that test were selected and put in the form of a brief power test. Since 



ERIC 



'he items in the WRVT are (according to the Manual) arranged in order of 
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difficulty, a selection vas made of every odd-numbered item from items 
1 to 49 in order to provide a suitable range of difficulty for the 
populations to be used in this study. ^ Since this test vas not to be used 
for individual diagnosis or guidance of any kind, it vas felt that even a 
test of 25 items vould provide sufficient reliability of scores for the 
purposes of this research. 

The tests were assembled in two 4-page booklets: one booklet, to be 

administered first, contained the sentence evaluation test (one page of 
instructions, one test page) and the 25-item vocabulary test (one page); 
the other booklet vas exclusively devoted to the headlines test. The cover 
page for each booklet provided space for the student to ^ tte his name and 
age. (Sex vas not included as a variable in this study.) Each of the 
booklets, of course, vas printed in alternate forms for ec.ch level; there 
vere in all 9 booklets for the sentence evaluation test and 6 for the 
headlines test. The booklets contained identical cover pages (except for 
level and form designation); the vocabulary test vas identical in all of 
the sentence evaluation booklets. Samples of sentence evaluation and headline 
booklets are given in Appendix S. 

Samples tested 

As vas seen in the discussion of the construction of instruments, it 
vas planned to administer the alternate forms of these instruments to random 
divisions of the classes to be tested, in order to obtain statistically 
valid comparisons of proportions of correct responses to !-!GF— H and MGF-L 
usages. Because each vord vas presented in different usages in two test 
forms, a further design feature vas that there should be a ? x 3 design 

^Thcre vere two exceptions to this rule. Item 20 vas used instead of 19 
because 19 etneerned a vord used in this study, PRIoERVl. Iter. '\h vas taken 
® instead cf 43 because the latter concerned a word considered to be somewhat 
S\J outdated , COIFFURE . 
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such that equal numbers would take each possible combination of alternate 
forms at a given level. This was done in order to investigate any possible 
interaction between types of test instruments and the usages represented 
in given forms. In view of the fact that the instruments were administered 
in a constant order , it was possible that the responses to the headlines 
items might be affected by the usages of the words that the examinee had 
encountered when he took the sentence evaluation test. It was planned to 
test the possibility of this interaction by a two-way analysis of variance 
with m cases per cell. At the data collection stage, the six possible 
form combinations were distributed to random sixths of the classes tested. 

At the data analysis stage, cases were eliminated randomly in such a way 
that the numbers in each cell of the 2x3 matrices for each level and 
grade were equalized. 

To obtain data that would permit comparisons between grades for a 
given level, Level 1 was planned to be administered to classes at both 
grades 3 and 6, while Levels ?_ and 3 ware to be administered to classes at 
both grades 6 and 9 . (Levels 2 and 3 were considered to be too difficult 
for grade 3 children, and Level 1 too simple for grade 9*) To the extent 
possible, the assignment of a particular class to a level was to be random. 

To obtain sufficiently reliable results, it was felt desirable to 
administer each of the three forms of the Sentence FValuation Test to a 
minimum of 100 pupils at each level end grade to be tested, and correspondingly, 
each of the two forms of the Headlines *est to a minimum of 150 pupils at 
each level and grade. Data collection activities were planned with this 
objective In mind, but the objective was not completely attained in all 
cases. The objejtive was over-fulfiUt 1 for level 1 nt grade 3, however, 
where puoils were tested; Ji was satisfactorily fulfilled for all levels 

o 

FRI C ade £ , where 301, 357, and 3$V pupils were tested with Levels 1, 2, and 3, 
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respectively . At grade 9, the numbers of pupils tested with Levels 2 and 3, 

287 and 283 respectively, were slightly short of the goal. 

In all, more than 2000 pupils vere tested in Kay 1970- These pupils 
comprised practically all pupils at grades 3* 6, and 9 at 17 schools in 
inree communities- The largest number, 823, came from elementary, middle, 
and secondary schools in Dover Capital School District, Delaware - An 
almost comparable number, 708, came from a similar distribution of schools 
in Ben snlem Township, Pennsylvania (on the northern edge of metropolitan 
Philadelphia) and 473 came from all three levels of schools in New Brunswick, 

N, J, In each community an effci't was made to obtain cooperation from 
a representative group of schools in the lower grades; in all three communities 
the grade 9 pupils were from a single j mi or or senior high school that drew 
from all segments of the community- It is bel ieved that the samples can be 
regarded as reasonably representative of grades 3, 6, and 9 in these communities 




P rocedures in test adm ini stmt i on 

Testing was personally conducted by research assistants from the projee- 
staff. They introduced the testing as part of a research project concurred 
with the development of English language skills; pupils were told that the 
results would have no bearing on their school grades. Pupils vere directed 
to follow the printed instructions for each test. 

The arrangements for the testing permitted the work to be dona r t a 
single sitting, which was generally a class period 01 40 to 50 minutes in 
length- This time prove- ample to all^v all nearly ell pupils to complete 
the tests (in th~ sense of trying all items). The order of testing was 
constant for all pupils: The Sentence Evaluation (Word Uses) test was 

performed first, fol'oved by the 2; vocabulary items er.i the Headlines test. 
As pupils finished the booklet containing 4 he f entencc Evaluation Test a..i 
the vocabulary test, they had to pass then in, at which tire they were 
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pennitted to begin work on the Headlines test. All tests were given, 
therefore, without time limits. 



Scoring of the tests 

The Sentence Evaluation and vocabulary tests presented no problem in 
scoring since they were of a completely objective type. After the raw data 
on the responses for these tests were keypunched, the following scores were 
obtained by computer: 



S e nt enc e kVa 1 ua t i on Te s t : 

E^ Number correct (marked RIGHT) for KGF-H items 
K No. no response for KGF-H items 
E~ Number correct (marked RIGHT) for MGF-L items 
Ef; No no response for KGF-L items 

E INunber correct (marked WRONG ) for anomalous items 
Eg No. no response for anomalous items 
E 7 Total number correct ~ E^ v t 

Eg Total number no response — E^ r Eg 



Wide Range Vocabulary Test (adaptation): 



Number correct 

Form ul a score — R - (1/4) W, rounded to an integer 
Number of last item marked 



Ihe responses to the Headlines test, however, had to be scored by 
subjective methods, lor each response, it was necessary to evaluate whether 
the paraphrase written by the subject reflected an adequate degree of 
comprehension c-f the underlined word in the stimulus sentence. 

After considerable working over of the response data, the following 
assumptions end codes were established: 

Assumption 1- The score is to be assigned on tin basis of the coder’s 



judgment of the respondent ’ s understanding of the u nderlined word. 

Assumption 2: The score should net depend upon the respondent’s 

understanding , or lack of understanding, of the remainder of the sentence. 

o 




Codes: 
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1 : Correct in the intended meaning and grammatical function 

(i.e., the ’'high frequency" usage for MGF-H vords and the 
"lov frequency" usage for MGF-L vords), 

?. : Correct in the intended grammatical function, hut in a secondary 

meaning, 

3 : The word was understood in a grammatical function and meaning 

conti ary to that intended in the construction of the item. 

(Note: For most items, this constituted an incorrect response. 

However, it turned out that e few of our items were am.big 1 ous 
in that they were open to two or more interpretations. See a 
further note on this matter below.) 

4 : Incorrect: meaning clearly not understood, 

5 : Fbrtial comprehension: understanding of the intended meaning 

and grammatical function was necessary to make the response, 
but the response itself does not properly represent the under- 
lined word . 

6 : Nonscorable: the coder cannot objectively judge whether or not 

the underlined word was understood. (I.e., no evidence of the 
meaning of the underlined word appears, or an ambiguous word is 
used in the response so that the meaning is not clear.) 

7 : The response represents [by a kind of unconscious play on verdsj 

both of the intended meanings and grammatical functions. 

8 : Nonscoruble because of 

(a) illegibility of response 

(b) irrelevancy of response 

(c) use of the under lined word or its compounds or inflections, 

contrary to directions. (An exception was that "turn 
over" was acceptable as a paraphrase of OVERTURN.) 
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9 : Nonscorable because there is evidence that the response was 

copied from another form of the test ( "cheating”) , 

0 : Tto response: nothing written. 

All response positions were inspected by one of several research 
assistants assigned to do the coding, and codes were assigned according to 
the above scheme. In general, results were analyzed on the basis of the 
coding of a single person. Coders vent through a training period in which 
the above codes were developed and discussed. After this training period, 
a formal study of coding reliability was carried out. 



Coder reliabi l ity study - Headlines Test 

First, by pulling every nth paper in the total set available for a 
given foiti and level (including both grades for a given level) --with n 
adjusted to yield the correct result for a given set of papers — each of 
three coders selected approximately 50 papers in Form A and 50 papers in 
Form B, at a given level, and proceeded to code them according to the 
key th/it had been established. Fach set of coded papers was then further 
divided into two sets, each of these sets then being independently coded 
by one of two other coders. In this way reliabilities of coding could be 
established for all possible pairs of coders for both forms for two of the 
three levels. That is, if we designate the coders by the letters A, B, and 
C, two independent sets of codings were obtained according to the following 
scheme (numbers in cells ere numbers of papers coded): 



level 1 



level 2 

O 




Coder 

Combination 


Form A 


Fom B 


Total 


A -13 


£5 


26 


51 


A -C 


£2 


25 


50 




50 


51 


Id 


F-A 


£4 


2o 


50 


B-C 


SI 


si 


JL° 




*9 


51 


106 
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Coder 


Combination 


Foim A 


Form B 


Total 


C-A 


26 


29 


55 


C-B 


20 


26 


A6 




sg 


55 


101 



A computer program vhs written to analyze the results of this coder 
reliability study item by item. For each item, form, level, and pair of 
coders, the percentage of agreement was computed on the basis of the 
ratio of the nusber of exc.ct agreements in coding to the total number of 
codes assigned, exclusive of cases of no response . Out of 252 Item-agreement 
percentages so formed, exactly one-third were 100$* The remainder ranged 
from 66# to 96#, the median of the total distribution being at 95#* This 
would appear to represent a satisfactory level of agreement. 

Table 5*2 provides a summary of the item-agreement values . Certain 
trends are apparent in this table, but they are so slight that it has not 
been considered worthwhile to test them for significance: 

(1) There is slightly Jess agreement on the coding of T! lcv frequency" 
grammatical functions than for the coding of the "high frequency" grammatical 
functions . 

(2) The coding of items in Form B is slightly less reliable then that 
for Form A items. The only explanation that can be offered for this is 
flat the coders worked on Form B subsequently to Form A, and possibly 
became slightly less attentive by the time they reached Form S. 

(3) Coding was slightly less reliable with increasing level. This 
effect, however, may be associated with the assignment oi coder pairs; 
pa<r A-C tended to show less agreement than the other pairs. It cannot be 
said, however, that any one coder was consistently less in agreement with 
his colleagues than the other coders. 

Table 5.3 presents for each level a matrix shoving the joint frequency 
ist-ributicn of individual codes, sunned over items and coier-c^M nations. 

ERIC 



121 

-113- 

Table 5.2 

Results of Coder Reliability Study for Headlines Test 
Entries ^re Average Percentages of Agreement over Items 



Form A 



Form B 



Both Forms 



H vs . 

Level L 



o 

ERIC 



Coder Combination 
Total 



Coder Combination 
Total 



Coder Combination 
Total 







A-B 


A-C 






A-B 


A-C 






A-B 


A-C 






1 


H 


99.19 


91.84 


95- 


.37 


96. 4o 


89.09 


92. 


■ 95 


97.86 


90.53 


9h. 


,22 




L 


98.67 


89.06 


93. 


,66 


98.65 


88.03 


93- 


,21 


98.66 


88.51 


93, 


,*43 




Total 


98.9** 


90.51 


9 l *. 


,56 


97.58 


88.52 


93. 


.09 


98.26 


89.52 


93, 


,82 






B-A 


B-C 






B-A 


B-C 






B-A 


B-C 






2 


H 


92.39 


93.24 


92, 


,86 


92.24 


94.86 


93- 


.50 


92.31 


94.09 


93, 


.20 




L 


94.44 


95.42 


9^. 


.92 


88.09 


92.74 


90, 


.27 


91.41 


94.14 


92, 


,71 




Total 


93.46 


94 . 38 


93. 


,94 


90.26 


93.85 


91. 


.96 


91.86 


94.12 


92, 


*95 






C-B 


C-A 






C-B 


C-A 






C-B 


C-A 






3 


H 


99-43 


89.62 


93. 


.88 


97.47 


89.70 


93. 


,28 


98.50 


89 .66 


93, 


.60 




L 


99. **1 


35.37 


91- 


.48 


94.35 


83.26 


88 , 


.1*8 


96.76 


84.26 


89- 


*91 




Total 


99.42 


87.59 


92, 


.74 


95-84 


86.33 


90. 


*77 


97.63 


86 . 96 


91. 


.75 








By Coder 


Combinations : 




















A-B 








A-C 








B-C 










Level 1 


98.26 




u 


^vel 1 


89.52 




Level 2 


94.12 










Level 2 


91.86 




Level 3 


86.96 




Level 3 


9T/63 







Combined 95-06 



Combined 95*67 



Combined 83 . 2*4 
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The row and column suras (labeled RS and CS, respectively) show the 
distributions of codes assigned. (The occasional cases in which "0", the 
"no response 11 code, was paired with another code are not reflected in rov and 
column sums; these represent either coding or punching errors but are of 
negligible frequency.) There seems to be no particular pattern of disagree- 
ment or confusion in these matrices; the various codes are confused with 
each roughly in proportion to their relative frequencies. 



Scores a 



The 

H„ 



PL 



ssigned for Headlines Test 

following scores were obtained by computer for the Headlines Test: 

Number correct (codes 1 and 2, and sometimes 3*) for words in 
high frequency usage 

Number of "no response" codes (cede 0) for words in high frequency 
usage 

Number correct (codes 1 and 2, and sometimes 3*) for words in 
low frequency usage 

Number of "no response" codes (code 0) for words in low frequency 
usage 

Total number correct (H^ n- K^) 

Total number "no- response” (H^ + ) 

Difference between number correct for high and number correct for 
low (H x - H 3 ) 



Ae noted earlier, certain items were recognized as being ambiguous, 
i.e., open to interpretation using either the "high frequency" or "low 
frequency" usages. A code of ”3" for the following items was scored as 
"correct" : 

Level 1, Form A, Item 19 : RUNNER GAME FOR RACE 

(intended: "low usage," adjective) 

Level 1, Form B, Item 2: PRIVATE SCHOOLS OPEN 

(intended: "high usage," edjective) 



Level 1, Form B, Item p: TEACHERS FACE GRAVE PROBLEM 

(intended: "lev usage," adjective) 



Codes (l Coder) 
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Table 5 . 3 

Reliability Check Summary Matrix — MGF Study-Phase Ii 
Level 1 (N = 101 ) 

Codes ( 2 n ^ Coder) 





0 


1 


2 


3 


4 


5 


6 


7 


8 


9 


RS 


0 


1*141 


0 


0 


0 


0 


0 


0 


0 


0 


0 


( 1 * 1 * 1 ) 


1 


6 


936 


2 


1 


u 


7 


3 


0 ' 


2 


0 


955 


2 


1 


0 


15 


0 


1 


0 


0 


0 


0 


0 


16 


3 


0 


1 


0 


23 


1 


0 


0 


0 


0 


0 


25 


4 


0 


k 


1 


0 


174 


8 


7 


0 


10 


0 


204 


5 


0 


9 


0 


0 


4 


112 


2 


0 


4 


0 


131 


6 


0 


0 


0 


0 


4 


3 


100 


0 


3 


0 


110 


7 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


8 


0 


2 


2 


0 


7 


2 


3 


0 


215 


0 


231 


9 


0 


0 


0 


0 


0 


. 0 


0 


0 


0 


1 


1 


cs< 


(1.1*8) 


952 


20 


24 


195 


132 


115 


0 


234 


1 


1673 



/?AGREE= 1576 $AGREE= 9^.20 



o 
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Codes (1 Coder) 



124 

- 116 -.' 



Table 5 ■ 3 (Contd. ) 



Reliability Check Summary Matrix — MGF Study-Phase II 
Level 2 (N = 100) 

Codes (2 n< * Coder) 





0 


1 


2 


3 


4 


5 


6 


7 


8 


9 


RS 


0 


201 


0 


0 


0 


0 


0 


1 


0 


0 


0 


(2C2) 


1 


k 


913 


0 


0 


3 


16 


3 


0 


1 


0 


936 


2 


0 


0 


20 


0 


0 


1 


0 


0 


0 


0 


21 


3 


0 


u 


0 


8 


0 


0 


0 


0 


0 


0 


8 


h 


2 


2 


1 


1 


252 


8 


5 


0 


8 


c 


277 


5 


0 


27 


0 


1 


11 


QOO 


2 


0 


U 


0 


26 ? 


6 


0 


0 


0 


1 


3 


1 


35 


0 


2 


0 


h2 


7 

1 


0 


0 


0 


0 


0 


0 


0 


3 


0 


0 


3 


8 


1 


k 


0 


1 


12 


3 




0 


312 


0 


337 


9 


0 


0 


c 


0 


0 


0 


0 


0 


0 


0 


0 


cs 


(208) 


9h6 


21 


12 


2 Sl 


251 


50 


j 


327 


0 


1891 



#AGREE<= 1?6S jfAGREE® 93. 3 1 -* 



o 

ERIC 



Codes (l Coder) 



12 o 

-117- 



Table 5.3 (Contd.) 

Reliability Check Summary Matrix--MGF Study-Phase II 
Level 3 (N = 101 ) 

Codes (2 nd Coder) 





0 


1 


2 


3 




5 


6 


7 


8 


9 


RS 


0 


432 


0 


0 


0 


1 


1 


0 


0 


0 


0 


(1*34) 


1 


0 


649 


0 


0 


13 


14 


1 


0 


3 


0 


680 


2 


0 


0 


12 


0 


0 


0 


0 


0 


0 


0 


12 


3 


0 


0 


4 


42 


2 


0 


0 


0 


1 


0 


49 


4 


c 


6 


1 


1 


354 


8 


2 


0 


8 


0 


380 


5 


0 


14 


1 


0 


10 


169 


2 


0 


3 


0 


199 


6 


0 


4 


0 


1 


9 


4 


37 


0 


1 


0 


56 


7 


0 


4 


0 


0 


C 


1 


0 


2 


0 


0 


7 


8 


0 


1 


1 


2 


13 


2 


1 


0 


284 


0 


304 


0 


0 


0 


0 


0 


0 


0 


G 


0 


0 


c 


0 


'S 


(432) 


678 


19 


46 


L 01 


198 


43 


2 


300 


0 


1687 
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0AGRES= 1549 $AGREE= 91.820 



Level 3, Form A, Item 1 : 
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NQVEL IDEA WTUS ATTENTION OF SCIENTIFIC LEADER 
(intended: ’'low usage / 1 adjective) 

Level 3, Form A, Item 20: PROSECUTOR PRESETS PRIMARY EVIDENCE 

(intended: T 'high usage/' adjective) 

It is interesting to note that every one of these 'ambiguous 1 ’ items was 
originally written with the intention that the underlined word “be interpreted 
as an adjective, and that the alternative and possible interpretation of 
the word as a noun was overlooked. In retrospect, it appears that it would 
have been difficult to write the items in such a way as to preclude the 
alternative interpretation. 



RESULTS 



In order to obtain equal numbers of cases in the cells of the 2x3 
table of combinations of Evaluation and Headlines test foncs, it was 
necessary to exclude a certain number of cases randomly. The final results 
were based on 1866 cases, with the exclusion of 133 cases, broken down as 



.w is : 






Total Cases 




Total Cases Used 


Cases Excluded 


Available 


Level 1, Grade 3' 


414 


15 


429 


Level 1, Grade 6 : 


2 'tO 




29-6 


Level 2, Grade 6 : 


• ;o 


19 


333 


level 2, Grade 9: 


270 


lL 


284 


Level 3, Grade 6 : 




23 


347 


Level 3? Grade 9: 


282 


6 


1 11 
1 <3 




1866 


133 


1999 



The figure of 3999 cases available is exclusive of about 10 cases that for 
seme reason had taken only one of the two tests. 

The nejor results of the study are displayed In Tables 5-5, 5.6, a r.d 

5.7 which appear on pp. 131-175- Tables 5.4 and 5 , 5 , which concern the Senter.c 



Evaluation test and the Headlines test, resjv :tively, ere organized in three 




parts for ea^h level and gi^ade combination: 
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(a) For each word, frequencies and proportions of correct and incorrect 
responses to words in "high" and "low" frequency grammatical 
function (and "anomalous" function, for the Evaluation test data), 
with significance tests for the contrast between "high" and "low" 
usage responses; 

(b) For each word, an analysis of variance of the proportions of 
correct responses in the 2x3 table of form combinations, in order 
to test the possibility of interaction between forms; 

(c) For each word, biserial correlations of correct responses to 
"high," "low," and (for Evaluation Test responses) "anomalous" 
stimuli, with age, vocabulary score, evaluation test score, and 
headlines test score. These tables also give mean age, vocabulary, 
evaluation, and headlines test scores for those giving a correct 
response. As will be noted, there is some systematic variation 

in evaluation and headlines test scores depending upon form; 
these tables therefore give mean scores for age, vocabulary, evaluation, 
and headlines by form. Evaluation and headlines test scores are 
those identified as E and above. 

Table 5.6 gives, for each level-grade combination, intercorrelations among 
the variables age, vocabulary, evaluation score, and headlines score, for 
each Evaluation-Headline test form combination, as well as significance 
tests for differences in mean scores of these variables among or between 
evaluation test forms and headlines test forms, respectively. 

Table 5.7 gives, for each level, information concerning the significance 
of differences between proportions correct on each word at the two grades 
within a level. 

These results per .it giving a number of fairly definitive answers to 
rn?r^ er of questions towards which this study was oriented. 



First we must consider a number of essentially methodological questions: 

(1) W as the random assignment of cases to e v aluation and headline test 
form combinations successful in yielding comparable groups ? To answer this 
question, we examine the results of the ANOVAS for age and vocabulary in 
Table 5-6. Both age and vocabulary scores would appear to be relevant 
control variables for checking randomness of selection. Furthermore , it 
will be observed in the analysis of the biserial correlations in Tables $.h 
and 5*5 that both age end vocabulary show significant correlations with 
performance on the evaluation and headlines test. 

The answer to the question raised here appears to be affirmative. 

Out of all the 60 probability values for the F-ratios computed for age and 
vocabulary contrasts among evaluation form scores or between headline form 
scores in Table 5*6, only one passes the usual test of significance; it is 
a probability value of .003 * It is probably to be taken as reflecting a 
chance sampling effect. Cn the whole, the 60 probability values form an 
approx iiuately reiv ugular distribution, as one would expect them to do if 
the samples were randomly selected with respect to age and vocabulary coore. 

(2) Is there any interaction or oth er Inf luence b etween the Evaluation 
forms and the Headlines forms ? To answer this question, we examine the 
analysis of variance results given in those ports of Tables 5-'t and 5*5 
which show proportions of correct responses broken down by fora combinations. 
Actually, since the pupils took the Evaluation test before they took the 
Headlines test, the results for the Evaluation test (in Table 5**0 should 
have no bearing on the question of interaction. Significant interactions 

in Table 5 .4 should arise only as a matter of chance fluctuation. Out of 
X2& F-ratics for form x form interaction in Table 5.4, only 3 are significant 
at the 1$ ievel—vhereas one would expect about 1 by chance. There arc also 
4 F~ratios for the Headlines test that arc significant at the .1# level 
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(ln fact, 2 of them are significant at the .1$ level); these, however, must 
be regarded as arising from sampling fluctuation because it does not make 
sense to assume that -che performance on the Evaluation test could have 
differed depending upon which Headlines test form the pupil was to take 
subsequently. 

The results in Table 5.5 could, however, Vu interpreted as showing 
a significant effect of the Evaluation test form upon performance in the 
Headlines test — if indeed there were any large number of significant 
interactions, but as a matter of fact, there are no interactions in Table 
5.5 significant beyond the 1$ level; only 2 are significant at the 5 $ 
level, fewer than one would expect by chance. 'There are 4 F~ratios for 
the Evaluation test main effect that are significant beyond the 1$ level; 
such F-ratios, if truly significant, would indicate that performance on 
the Headlines test varied significantly depending upon which Evaluation 
test form had been taken. The most extreme case is that for the word 
PRIVATE at Level 1, grade 3, where the overall proportions of correct 
response to the Headlines items (both '’high” and "low" usage) were .101, 
.246, and .116, respectively, depending upon whether the pupil had been 
exposed to the word in its ’’high, 1 ’ "low,” or "anomalous 1 ’ usage in the 
Evaluation form. That is, pupils paraphrased the Headlines items better 
if they had been exposed to the item in the "low 11 Evaluation item: "A 

private von a medal during the war." One might attempt to interpret this 
result if a similar phenomenon occurred with the same item at grade 6, but 
it did not; in fact, the overall proportions at grade 6 were - 550 , .487, 
and .412, respectively. Thei'e was in fact no case in which consistent 
results of this type were obtained for an item at the two grades where it 
was tested. Ve may then conclude that there were no truly significant 
® . interactions or other influences operating between the Evaluation test forms 
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and the Headlines test forms. The results obtained with the two types of 
tests can be regarded as experimentally independent . (this is not to say, 
of course, that the date were ^correlated. As we will see,, there is 
evidence that performances on the two tests were correlated in the sense 
that students who did well on one test also tended to do veil on the other.) 

( 3 ) Are the different forms of the Evaluation test ard the Headlines 
test, respectively, equivalent in difficulty ? In advance of the analysis 
of data there was no way of insuring Torn equivalence , and as a matter of fact, 
form equivalence was not necessary for the design of the study since analysis 
was to focus on the results for individual words. It was desirable to 
investigate form equivalence, however, in order to see whether it would be 
feasible to pool scores from different forms for correlational analysis. 

Means Evaluation test and Headlines test scores, by fonn, for each 
level and grade, are to be found in Tables 5,4 and 5.5* However, they are 
summarized below, with appropriate significance tests: 

Mean Evaluation Test Scores 
(Maximum Score Possible Is 21) 





Fonn A 


Form B 


Form 0 


F 


P 


Level 1, Gr. 3 


13.54 


14. 4i 


15.36 


9-78 


<.001 


Level 1, Gr. 6 


15.89 


17.69 


17.91 


15.45 


<.001 


Level 2, Gr. 6 


16.05 


15.38 


15.44 


c. . r.d 


>.05 


Level 2, Gr. 9 


17.41 


16.99 


16.72 


1.83 


>.05 


Level 3 , Gr* 6 


14.10 


13.02 


14.41 


6.23 


<.01 


Level 3 , Gr. 9 


15.93 


15.70 


15.93 


.28 


n.s . 
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Mean Headlines Test Scores 
(Maximum Score Possible Is 2l) 









Form A 


Form B 


F 


P 


Level 1, 


Gr. 


3 


6.63 


4.39 


26.43 


C 001 


Level 1, 


Gr. 


6 


13.48 


9-52 


28.35 


<.001 


Level 2, 


Gr. 


6 


7.92 


9.20 


5.02 


<.05 


Level 2, 


Gr. 


9 


11.86 


11.75 


.03 


n, s. 


Level 3 } 


Gr . 


6 


6.39 


6.17 


.20 


n. s . 


Level 3, 


Gr. 


9 


10.72 


9.05 


8.99 


<.01 


The 


Evaluation 


test forms 


are consistently 


nonequivalent at 


level 1; 


at the other 


levels 


they are approximately equivalent except at 


Level 3, 


grade 6. 


A 


somewhat 


parallel 


situation exists 


for the Headlines 


test forms 



they are consistently nonequivalent at Level 1, but show approximate 
equivalence at some other levels and grades . 

Because of the varying degrees of form equivalence, we have avoided 
computing correlational data using scores pooled across forms. 

He suits for the Main Hypotheses of the Study 

The main hypothesis of this study was that school-age children will 
have more difficulty in understanding sentences in which words are used in 
re]atively less frequent grammatical functions than sentences in which 
these words appear in more frequent grammatical functions. 

Data bearing on this hypothesis appear in Tables 5^ awi 5-5. In 
Table 5 .k , pertaining to performance on words in the Sentence Evaluation 
test, we have for each level and grade combination the proportions of 
correct responses to words in "high frequency" grammatical function as 
ompnred to ihe proportions of correct responses to words in "low frequency 
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grammatical function, and the significance of the differences. (The 
proportions of correct responses to words in "anomalous 1 ’ usage are also 
given, hut since these items were merely "fillers," they ^re of no immediate 
interest here.) 

Likewise, in Table 5.5, pertaining to responses in the Headlines test, 
ve have figures for the significance of the differences between proportions 
of correct responses for "high frequency" and "low frequency" items. 

In both cases, the significance tests were computed so that positive 
values would favor the hypothesis. Table 5-8 (p. 176) Is a summary of these 
significance tests. From this table, it is seen that the majority of the 
tests favor the hypothesis, particularly in the case of those from the 
Sentence Evaluation tests. A simple sign test of the number of differences 
favoring the hypothesis yields the answer that all of the level-grade 
results for the Evaluation test favor the hypothesis at better than the 
.001 level; i.e., at least 18 out of the 21 words at each level and grads 
show differences in favor of the hypothesis . For the Headlines test, the 
results are not so consistently in favor of the hypothesis, but the trend 
is certainly in that direction. 

It is even more noteworthy that for the Evaluation test, 77 out of a 
possible total of 126 differences were positive and significant beyond the 
.1$ level; no differences were negative and significant at the same level. 

For the Headlines test, bo out of 126 differences were positive and 
significant beyond the .1$ level, while 21 differences were significant 
at the sfmie level but in an opposite direction. 

These insults would appear to confirm the major hypothesis of the 
study. Before drawing a final conclusion, however, it is necessary to 
examine the results mere closely. It is possible, for example, that differing 
grammatical function was not the critical faccor, or not the only critical 
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factor. Semantic differences correlated with grammat ical functions could 
have produced the results; that is to say, it is possible that the 
respondents were less familiar with infrequent semantic usages of the words 
and that the differences between "high frequency" and ’’low frequency" 
grammatical usage responses were most striking when such semantic differences 
existed. 

To explore this possibility, consideration was first given to contrasting 
the results for words in semantic code "1" with the results for words in 
the other semantic codes. (See Chapter II for a description of these semantic 
coles.) However, it appeared more useful to regroup the words in terms of 
whether important semantic differences were actually present in the 11 high" and 
"low" usages employed in the Evaluation and Headlines forms. Pertinent data 
were then culled from the previous tables and reorganized in the form of 
Table 5.9 (pp. 1 77-182). The preparation of this table also afforded an oppor- 
tunity to align results from the two grades within a level in order to examine the 
degree of consistency across grades. Also, the table presents data on the 
biserial correlations of the responses with Vocabulary scores, data that are 
of considerable interest in interpreting the overall results. 

At Level 1, 8 words were Judged to have essentially the same semantic 
content in both H and L grammatical usages in both the Evaluation and 
Headlines tests, while 13 words were Judged to have important semantic 
differences associated with differences in grammatical function. Among the 
former words, for example, were AGE (H-U, L-V), END (H-N, L-V), and TAKE 
(H-V, I/**! I ) • Among the latter were such words as CHANCE (H-N, L-V), PKEE 
(H-A, Ir-V) , and GAME (H-N, L-A) : in the H usage, CHANCE had the meaning 

"opportunity” ("We did not have a chanc e to see them"), whereas in the L 
usage, it had the meaning "take a risk 11 ("The driver said he would chance 

o 

ce in the snow"). Similarly, in the H usage, FREE had the meaning 
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"gratia" whereas in the I- usage it had the meaning "set loose"; in the H 
usage, GAME had its usual meaning whereas in the L usage it had the meaning 
"plucky. 11 

It does not seem worthwhile to attempt to make exact statistical 
comparisons of the results for the two groups of words; there were, indeed, 
more instances of highly significant comparisons for the group of words with 
semantic differences . In the group of words with simila r meanings in two 
grammatical functions, EM), LINE, NAME, SIGHT, and WISH were consistent 
across grades in not exhibiting any significant differences between H end 
L grammatical functions in the Evaluation test. In the group of words with 
d ifferent semantic content in the two grammatical functions , there was no 
word that did not show a significant difference (at the 5$ level or better) at 
at least one of the +vo grades. Tb^se results would suggest that at least 
a part of the variation in results may have been due to differences in semantic 
content such that the pupils were less familiar with the less frequent 
semantic usages. Such a result confirms observations that have been made 
quite often in the past (e.g., by Berwick, 1952 ; Howards, 1964 ; Thevaos, 1951 )« 
On the other hand, even among the words with similar semantic content 
in the two gi^ammatical functions, four were consistent in exhibiting signif- 
icant differences (at the 5$ level or better) in the hypothesized direction 
over the two grades: AGE, FILL, SIGHT, and TAKE. For the following pairs 

of sentences, significantly fewer students marked the L usage ss "correct": 

If He told me his age . 

L The trees ago every year. 

K The men will fiTl in the hole with dirt. 

L They need fill for the holes in the road. 

H The valley was a pretty s ight from the hill. 

L If you are lucky, you will s ight a star. 

H Our class will take a trip to the zoo. 

L The hunters returned with a big take . 
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If one supposes that the L usages are indeed "correct" or acceptable , these 
results suggest that the pupils tend to show difficulty in understanding 
words in unusual grammatical functions even when the semantic content is 
essentially the same as that associated with the more frequent grammatical 
function. 

We have discussed uhe results for Level 1, Evaluation test in detail. 

The reader may inspect the remainder of the results for himself. The 
general conclusions that seem to emerge from Table 5*9 are as follows: 

(1) For the Evaluation test results, there is some tendency towards 

a greater incidence of highly significant positive results in the case of 
words in which semantic differences are associated with differences in 
grammatical function, but there exist also many highly significant positive 
comparisons for words in which semantic content is essentia] ly the same in 
the two grammatical functions. In general, these results tend to be 
consistent over the two g 2 ^ades sampled for a given level of the test. Ihe 
positive differences that are most striking in this respect are for the 
following words: AGE, FILL, SIGHT, TAKE, BOTHER, CHANNEL, DRUG, POLL, SNAKE, 

ECLIPSE, EPIDEMIC, IMPRESS, PARROT, PLANK, SLEIGH, SPLINTER, and STRUCTURE. 

(2) Somewhat similar conclusions arise from the data for the Headlines 

test: the results tend to be more significant for words with different 

meanings in H and L grammatical usage, but among the words with similar 
semantic content in H and L grammatical usages, there are many words which 
show significant differences across grades. Not as many of these differences, 
however, are significant in the hypothesized direction as is the case for 

the EV&luation test items. This may be because the Headlines test is a much 
more exacting task: the stuient must create a paraphrase for the item. 

The overall proportions correct are consequently much lower for the Headlines 

0 

FRir ms; the differences ray be due not only to the student's ability to 
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comprehend the word in a given usage hut also to his ability, or lack of 
ability, to write an appropriate paraphrase for the item. In any case, 
words that show more or less consistent results favoring the major 
hypothesis of this study are the following: AGE, LINE, WISH, CHANNEL, 

SCARE, ECLIPSE, EPIDEMIC, OVERTURN, PARROT, PRESSURE, SPLINTER, and 




STRUCTURE . 

The biserial correlations with Vocabulary scores shown in the table 
aid in the interpretation of these results. It seems reasonable to expect 
that Vocabulary scores, as measures of general verbal ability, would 
correlate with performance on the Evaluation nnd Headlines test. In fact, 
the correlations of Vocabulary scores with total Evaluation and Headline 
test scores are generally substantial, as shown in Table 5-6: the 
correlation is almost always higher with the Headlines test score than with 
the Evaluation score, however. This may be partly due to the fact that 
the Evaluation test is a much easier test, with a possible ceiling effect. 
More probably, the correlation is higher because the Headlines test, with 
its paraphrasing task, draws upon the pupil's general vocabulary knowledge 
to a greater extent. Still, the correlation of Vocabulary scores with total 
Evaluation scores is signif icantly positive in every case. 

It was anticipated that the bi serial correlations between vocabulary 
and performance on both Headlines end Evaluation items would be generally 
higher for items in "low frequency 11 grammatical usage; i :> vac reasoned 
that performance on low frequency items would make more demand or the 
student's general vocabulary. This turned out net to be the case, at 
least for the Evaluation test items. The correlations were on the average 
much lover for items in "lew frequency" grammatical usage than for "high 
frequency" giammaticnl usage. Possibly rranv of those who marked L item:-’ 
as "correct" were actually lov-verbal-aMlity students who were deficient 
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in the ability to discriminate correct and incorrect usages; if so, the 
biserial correlations for these items could be expected to be low. The 
fact is that the biserial correlations for Evaluation items were generally 
higher for the "H n items; that is, these are actually better discriminators 
of verbal ability. 

In contrast, the biserial correlations for Headlines items with 
Vocabulary scores were generally substantial, both for H and L usages. 

Comparisons across Grades 



Table 5.7 gives, for each level, comparisons of proportions correct 
between grades, for H, L, and A items in the Evaluation tests and for K 
and L items in the Headlines test. Nearly all the differences are in a 
positive direction, as one might expect in view of the general improvement 
in language skills that occurs with increasing age and grade levels, and 
the majority of the differences are statistically significant at the 5$ 
level or better. The improvement from grade 3 to grade 6 at Level 1 is 
especially striking, particularly for Headlines items of both the H and 
L types, but there is also improvement in H, L, and A types of Evaluation 
items. Nevertheless, even at grade 6 a number of L~type Evaluation items 
are still not recognized as correct by substantial prc portions of students: 
the items for CHANCE, FILL, GAME, GRAVE , KILL, PAGE, SIGHT, SKIRT, STRANGER, 
and TAKE. Also, for most of these words, the students performed poorly in 
writing paraphrases for L-usages in the Headlines test. Unfortunately, 
these words were not tested at grade 9; it would be interesting to do so 
in future studies. 

The comparisons between grades 6 and 9 at Levels 2 and 3 <i° not show 
the nearly urlversal improvement that was noted for the grade 3 vs. grade 6 
q — ijnr isons . However, performance on many words was already quite satisfactory 
ERJC grade 6, at least in the Evaluation test items. 
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At Level 2, all H usages in the Evaluation test are correctly recognized 
by at least 75$ of the students in grade 9 except APPEAL; however, the u-usages 
of BOTHER, CHANNEL, HEDGE, INCENSE, MOTOR, PLANE, IOLL, SNAKE, SWAMP, and 
WINE are recognizeu by fever than 75$ of these students. Generally, ttv se 
words are also ones that are not well paiaphrased in the Headlines test 
even Ly grade 9 students. 

At Level 3, all H usages in the Evaluation test are correctly recognized 
by at least 75$ of the students in grade 9 except BLOUSE (72.3/0 and TARRY 
(71*3/0 . L-usages are recognized by fewer than 75$ of these same students 
in the* case of ANIMATE, BLOUSE, BUFFALO, ECLIPSE, EPIDEMIC, IMPRESS, NOVEL, 
OUTPACE, PARROT, PENSION, PLANK, SLEIGH, SPLINTER, STRUCTURE, arid TARRY. 
Likewise, these are generally words that grade 9 students have particular 
difficulty in paraphrasing in the Headlines test. 
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— WORDS IN HIGH MGF — WORDS IN LOW MGF — WORDS IN ANOMALOUS USAGE— 
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Table 5-8 

Distribution of z-values from the Evaluation 
and Headlines Test, by Level and Grade 



Evaluation Test 



Level 1 



Level 2 



Level 3 





Gr. 3 


Gr . 6 


Gr . 6 


Gr. 9 


Gr. 6 


Gr. 9 
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+ > 


p < .001 
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13 


77 


+ • 


,c n < p <_ .01 
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ll 


+ > 


p > .05 
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“ » 
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2 
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“ J 


.01 < p .05 
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1 




2 




.001 < p <_ .01 
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” > 


p < .001 














0 






21 


21 


21 


21 


21 


21 


126 



Headlines Test 



Level 1 
Gr. 3 Gr. 6 



+ , p <. .001 
+ , .001 < p <_ .01 

+ , .01 < p <_ .05 

+» P > -°5 
p > .05 
.01 < p ^ ,05 

.001 < p <_ .01 

p < .001 



_b 

21 



7 

1 

1 

3 

b 

1 

21 



Level 2 Level 3 

Gr. 6 Gr. 9 Gr. 6 Gr . 9 Total 

6 L 12 

2 3 

1 
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3 

1 

_JL 

21 



3 

3 

2 

1 

J<_ 

21 
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3 

1 
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2 

1 

1 

1 

21 



1*6 

12 

7 

19 

12 

5 

b 

_21 

126 



0 

ERIC 
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Table 5.9 

Data Grouped by Whether Semantic Differences Were Associated with 
Differences in Grammatical Functions 



Level 1 
EVALUATION 

Proportions Correct r bis Vocabulary 



"Same" meanings 


in H 


and L grammatical functions 














Gr. 


3 




Gr. 6 




Gr, 


, 3 


Gr 


. 6 
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K 
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AGE 


• 797 


.391 


6.86*** 


.912 


.800 


2,03* 


.579 


.036 


.576 


,2h8 


END 


.812 


.855 


-0.97 


.975 


.938 


1.16 


.578 


.516 


.652 


.077 


FILL 


.8014 


.355 


7.56*** 


.925 


.175 


9 # 53**# 


.561 


-.1314 


.1405 


- .006 


LINE 


.88I4 


.80I4 


1.83 


.975 


.900 


1.96 


.301 


.1492 


.2014 


.338 


NAME 


.906 


.8148 


1.1*7 


1,000 


.938 


2 ,27* 


.312 


.320 
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• lM- 


SIGHT 


.612 


.1406 


6.91*** 


.912 


.575 


li.89*** 


.382 


-.080 


.150 


,132 


TAKE 


.826 


.232 


9.89*** 


*925 


.200 


9 '2^*** 


.I487 


-.076 


.1405 


.220 


WISH 


.812 


.855 


-0.97 


.887 


.962 . 


-1.80 


.19I4 


.5*40 


.1)42 


* O67 


’’Different 


" meanings 


i n H and 


L grammatical 


functions 










BROKE 


.855 


.761 


1.99* 


.987 


.825 


3.53*** 


.1457 


. .2749 


.586 




CHANCE 


.761 


.3814 


6.33*** 


.912 


.525 


5 .I5*** 


.1I49 


-.220 


.567 


.PkO 


FREE 


.761 


.572 


3.32*** 


.925 


.862 


1 .28 


.525 


.216 


.1422 


.335 


GAME 


.812 


.1^5 


11.09*** 


1 .000 


.250 


9 .80*** 


.395 


-.2146 


— 


. 37 h 


GRAVE 


.783 


.210 


9.51*** 


.950 


.1400 


7.I43*** 


.5*3 


- 16O 


.139 


. ^ 31 


LIVE 


.826 


.716 


1.62 


.962 


.787 


3.35*** 


.391 


.062 


.396 


.297 


MILL 


.710 


.210 


8.33*** 


.925 


.300 


8,il**» 


.516 


-.315 


.272 


.333 


PAGE 


.862 


.297 


9.51*** 


.962 


.512 


6.147*** 


.385 


.016 


.365 


. 391 


PRIVATE 


.775 


.522 


I4 .ll*** 


.912 


.775 


2.I40* 


.096 


.329 




.295 


SEASON 


.8I4I 


.623 


J).C8**» 


.936 


.800 


2.56* 


.1421 


.162 


.hjh 




SKIRT 


.619 


.159 


10.96*** 


.925 


.137 


9 .98*** 


.565 


-.159 


, id* 5 




STRANGER 


.797 


.362 


7.32*** 


.950 


.I438 


7 .03*** 


.1.67 


-.ill. 


.30!. 


.191 


TRAIN 


.826 


.616 


3.89*** 


.88 7 


.800 


1.52 


.ofo 


,095 




j ij 4 



o 
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Table 5.9 (contd.) 
Level 2 
EVALUATION 



Proportions Correct r bis Vocabulary 

"Sane'* mea lings in H and L grammatical functions 







Gr. 


6 




Gr. 9 




Gr. 


6 


Gr. 


9 




H 
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Z 


H 
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K 


L 


K 
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.875 


.1*73 


6.1,1*** 


.889 


.1*22 
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.288 - 


.101 


.229 - 
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.71*1 


2.17* 
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.856 


1.16 


.520 


.058 


.527 


.1*51* 


BUY 
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3,58*** 


.967 


.878 


2.23* 


.1+36 


.11*5 


- . 07 L 
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.339 


6.59*** 


.911 


• 533 


5.66*** 


.339 


.021* 


.1+96 


.196 


DRUG 


.9^6 
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5 .26*** 


1.000 


.867 


-> 1 59#*# 


.^15 


.396 


-- 


.291 


HUN 
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.786 


1.59 


.933 


.856 


1.70 


.229 


.371 


.253 


. 0 1*6 


KNOT 


.759 


.813 


-0.98 


.800 


.778 


0.37 


. 379 


.380 


.763 


.1*86 


POLL 


.536 


.211* 


1, ,97*** 


.889 


.367 


7.2f>*** 


.03^ - 


.260 


. L 66 - 


.075 


SCARE 


.777 


.732 


0.78 


.889 


.800 


1.65 


.632 


.170 


.61+2 


.251* 


SNAKE 


.955 


.339 


9 .65*** 


.956 


.556 


6.21+*** 


.239 - 


.006 


.600 


.093 


SPEAR 


.938 


.875 


1.60 


•989 


.856 


3 # 3I4#*# 


.808 


.209 


.1+09 


.386 


WORRY 


.857 


.598 


1*.35*** 


.856 


.356 


0.0 


.1+71 


.267 


. 375 


.106 


YELL 


.881* 


• 777 


2.11** 


978 


.933 


iM 


.1+86 


.257 


-.11+6 


.51*6 



"Different" meanings in H and L grammatical factions 



APPEAL* 


.688 


• 723 


-0.59 


.733 


.867 


-2.21** 


.101* 


.169 


.220 


.3^6 


HEDGE 


.929 


.393 


8.1*7*** 


.878 


.1*00 


6.67*** 


.196 


-.007 


.211+ 


.01+2 


incSnse 


.536 


.536 


0.0 


.822 


.322 


6.78*** 


.289 


-.191* 


.531 


-.273 


MOTOR 


.920 


.161 


11.1*0*** 


.91*1* 


.322 


8.66*** 


.1*78 


-.1*91* 


.211+ 


.057 


PLANE 


■ 955 


.286 


10.33*** 


.967 


.51*1* 


6.59*** 


.336 


-.136 


.11+8 


.131 


POLICE 


.920 


.1*38 


7,73*** 


1.000 


.789 


l* .61*** 


.639 


-.008 




.537 


SWAMP 


.938 


.1*61* 


7.73*** 


.978 


.689 


5.20*** 


.1*1*5 


.153 


.51+9 


.301 


TWINE 


.830 


.551* 


,149### 


.911 


.522 


5. 79*** 


.1*66 


-.171 


.339 


- .122 



Both T1 H" and M L n usages vere nouns, but with different meanings. 
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Table 5.9 (contd.) 

Level 3 
EVALUATION 

Proportions Correct r^ is with Vocabulary 

"Same" meanings In K and L grammatical functions 





H 


Gr. 

L 


6 

Z 


H 


Gr. 9 
L 


Z 


Gr . 
H 


6 

L 


Gr, 

H 


■ 9 

L 


ECLIPSE 


.870 


.296 


8.56*** 


.936 


• 319 


8.75*** 


.133 - 


.309 


.663 


-.006 


EPIDEMIC 


.796 


.528 


1 .17*** 


.936 


.670 


1 . 59*** 


.521 


.267 


.377 


,122 


HOIST 


.602 


.759 


-2.18* 


.787 


.787 


0 .0 


.368 


.251 


• 5l7 


.607 


IMPRESS 


.861 


.556 


.91*** 


.936 


.298 


9.00*** 


.587 - 


.585 


-.102 


-.646 


MELLOW 


.602 


.1*91 


1.61 


• 915 


• 755 


2.95** 


.220 


.301 


.105 


.131 


NIBBLE 


.852 


.731 


2.18* 


.926 


.777 


2.87** 


.112 


.275 


.312 


.237 


OUTRAGE 


.69!* 


.722 


-0.15 


.810 


.691 


2.1)1* 


.189 


.053 


.193 


.439 


OVERTURN 


.833 


.778 


1.03 


.883 


.872 


0.22 


.029 


.281 


.636 


.141 


PARROT 


.926 


.269 


9.85*** 


• 9l7 


.298 


9 .18*** 


.367 


.192 


.130 


-.100 


PENSION 


.657 


.593 


0.98 


.915 


.670 


1 ,il**« 


.376 


.211 


.270 


-.147 


PLANK 


.907 


.’35 


7.39*** 


.957 


.511 


6.93*** 


.>65 


.010 


.660 




PRESSURE 


.769 


.620 


2.36* 


.917 


• 915 


0.86 


.661 


.071 


.158 


.478 


SLEIGH 


. 769 - 


.1)81 


1 . 3b * * * 


.863 


• 57l 


I.76*** 


.332 - 


.060 


.169 


.102 


SPLINTER 


.907 


.1)26 


7.51*** 


.957 


.585 


6.06*** 


. 360 


.233 


.363 


.423 


STRUCTURE 


. 880 


.657 


3.87*** 


.901 


.619 


1.20*** 


.517 - 


.065 


.380 


- ♦ 106 


"Different’ 1 meanings 


in H and L 


grammatical 


functions 










ANIMATE 


.821) 


.556 


1 .27*** 


.936 


.553 


6.02*** 


.532 


.093 


.659 


-.044 


BLOUSE 


.537 


.333 


3.02** 


.723 


. 3 7 2 


1.81*** 


.104 


.055 


.510 


.039 


BUD PALO 


.926 


.278 


9 m 73*** 


.917 


.126 


7.70*** 


.486 


.173 


.069 


.153 


NOVEL- 


.852 


.620 


3.86*** 


.917 


.702 


1 .11*** 


.313 


.179 


.513 


.122 


PRIMARY 


.750 


.516 


3.13** 


.891 


.926 


-0.76 


.372 


.106 


.750 


.053 


TARRY 


.500 


.516 


-0.68 


.713 


.196 


1.69 


.144 


.299 


.211 


-.o\) 
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Table 5.9 (contd. ) 

Level 1 
HEADLINES 



Proportions Correct r bls Vocabulary 

M Same Ti meanings in H and L grammatical functions 





H 


Gr. 

L 


3 

Z 


H 


Gr. 6 
L 


Z 


Gr. 

H 


. 3 

L 


Gr. 

H 


. 6 

L 


AGE 


• 575 


.087 


10.55*** 


• 775 


.1*83 


l* . 68 *** 


. 1*86 


• 558 


.1*03 


.620 


END 


.169 


.31*3 


2 . 60 ** 


.717 


.833 


- 2 . 16 * 


.1*78 


.1*71* 


. 611 * 


.515 


r ILL 


.256 


.213 


1 . 01 * 


. 1 * 1*2 


.1*50 


-0.13 


.1*73 


.1*59 


.21*7 


. 1*18 


LINE 


.198 


.068 


3 . 91 *** 


• •*75 


.333 


2.21** 


.1*66 


.201* 


.1*91 


.501* 


NAME 


• 159 


.106 


1.59 


.367 


.1*83 


-1.83 


.308 


.266 


.51*9 


.1*85 


SIGHT 


.301* 


.507 


-1* .20*** 


.750 


.733 


-0.6l 


. 1*76 


.1*77 


.538 


. 1 * 71 * 


TAKE 


.183 


.329 


3.20** 


.61*2 


.683 


-0 . 68 


.222 


.311* 


.528 


.528 


WISH 


. 1 * 1*0 


.179 


5 /j'l;### 


.725 


• 517 


3.33*** 


.1*1*8 


.299 


.1*28 


.625 


"Dif ferent 


1T meanings 


in H and L 


grammatical 


functions 










BROKE 


.193 


.560 


- 7 . 60 *** 


. 1*25 


.792 


-5.82*** 


.338 


.1*23 


.393 


.378 


CHANCE 


.357 


.106 


6 . 06 *** 


.758 


.325 


6 . 7 I**** 


.316 


.263 


.387 


.628 


FREE 


.333 


. 1*25 


-1.92 


750 


.658 


1.56 


. 1 * 71 * 


.1*86 


.1*02 


• 550 


GAME 


.217 


.01*8 


5 .O 7 *** 


.1*1*2 


.275 


2.69** 


.395 


.21*0 


.1*71* 


.331* 


GRAVE 


. U 5 U 


.193 


5 . 67 *** 


.792 


.583 


3.1*8*** 


.615 


.1*23 


.556 


. 1*67 


LIVE 


.1*98 


.251 


5,10*** 


.750 


.1*25 


5.11*** 


.259 


.379 


.508 


.380 


MILL 


.111 


.063 


1 . 71 * 


.375 


.308 


1.09 


.21*6 


.21*3 


.595 


.1*22 


1 AGE 


.319 


.111 


5 . 11 **** 


.708 


.317 


6.07*** 


.1*70 


.339 


.658 


.1*67 


PRIVATE 


• 16 Li 


• 11*5 


0 . 51 * 


.31*2 


.625 


- 1 * . 39 *** 


.290 


.391* 


.290 


.631 


SEASON 


a 1*5 


.1*15 


-6.13*** 


.392 


.825 


-6.88*** 


.329 


.553 


.576 


.688 


SKIRT 


.309 


.005 


8.51*** 


.525 


.058 


•7 


.1*09 


.255 


.1*12 


.572 


STRANGER 


.121 


.058 


2.2)** 


.1*33 


.1*17 


0.26 


.323 


.566 


.1*51* 


.501 


TRAIN 


.179 


• 517 


-7.22*** 


.1*50 


• 792 


-5 . 1*5*** 


.281* 


.518 


.507 


. 1*56 



o 




183 

-181- 



Table 5-9 (contd.) 
Level 2 
HEADLINES 



Proportions Correct r Ms with Vocabulary 



"Same" meaning 


in H 


and L grammatical 


. functions 














Gr. 


6 




Gr. 9 




Gr, 


, 6 


Gr 


O 




H 


L 


z 


H 


L 


Z 


H 


T 


K 


L 


BOTHER 




.393 


1.87 


.726 


. c 70 


2.68** 


.607 


.175 


.160 


.561 


BUBBLE 


.351 


. 696 


-6.31*** 


• 311 


.830 


-8.61*** 


.301 


.601 


.237 




BUY 


.211 


.768 


-9.60*** 


.526 


.830 


_5 ,31**** 


.395 


.516 


.16? 


,5kh 


CHANNEL 


.310 


.107 


1.57**' 


.I7I 


.301 


2.8"?** 


• 515 


• l63 


167 


,b62 


DRUG 


.619 


.369 


1 .58*** 


.600 


.501 


- .59 


.110 


.163 


.119 


.390 


HUM 


.637 


.577 


1.12 


.630 


.7I8 


-2.10* 


.317 


.631 


• 389 


.^35 


KNOT 


• 5.C6 


.655 


-2.76** 


.622 


.830 


-3.82*** 


.151 


.617 


.528 


.h$6 


POLL 


.095 


.119 


-0.71 


.181 


. I7I 


0.12 


.510 


.153 


.601 


*598 


SCARE 


.815 


.268 


10 .07*** 


• 778 


.393 


6.12*** 


.568 


.307 


.393 


.1^9 


SNAKE 


.381 


.631 


-1.58*** 


.615 


.763 


-2.63** 


.599 


.532 


.622 


. 306 


SPEAR 


.196 


.256 


-1.30 


.230 


.267 


-0.70 


.171 


.103 


.260 


.1 bh 


WORRY 


.202 


.1*1*6 


-1 . 78*** 


• 511 


.518 


-0.61 


.218 


.601 


.386 




YELL 


.685 


,$h2 


2.69** 


.733 


.78? 


-1.00 


.526 


.166 


.302 


.339 


"Different 


,r meanings 


in H and L 


grammatical 


functions 










APPEAL 


.012 


.no 


-8.55*** 


.296 


.67I 


-6.21*** 


.139 


.611 


.I76 


, 570 


HEDGE 


.595 


.012 


10.89*** 


.681 


.207 


7.81*** 


.565 


• 515 


.296 


.521 


INCENSE 


.256 


.065 


1.75*** 


.181 


.163 


5,60*** 


.569 


.260 


.171 


.186 


MOTOR 


.I76 


.116 


0.55 


.701 


.578 


2.16* 


.6 15 


.198 


.386 


.369 


PLANE 


.521 


.113 


8.08*** 


.733 


.107 


5 .11*** 


.595 


.259 


.561 


.520 


POLICE 


.613 


.500 


2.65** 


.726 


.652 


1.31 


.137 


.120 


.192 


.5?>> 


SWAMP 


.327 


.268 


1.19 


.181 


.326 


2.60** 


.516 


.201 


.522 


.2 37 


TWINE 


.162 


.512 


-1.09 


.611 


.770 


-2.27* 


.526 


.628 


.519 


532 



O 
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Table 5.9 (contd.) 

Level 3 
HEADLINES 



Proportions Correct r bis Vocabulary 

"Same 11 meanings in H and L grammatical functions 







Gr . 6 






Gr. 9 




Gr. 


6 


Gr, 


, 9 




H 


L 


z 


H 


L 


Z 


H 


L 


H 


L 


ECLIPSE 


.1*20 


.21*7 


3.30*** 


• 596 


.1*18 


2.98** 


.1*99 


• **53 


*399 


.292 


EPIDEMIC 


.1*9** 


.071* 


8.38*** 


.7^5 


.206 


9.0g*» 


.605 


.257 


*687 


.328 


HOIST 


.1*26 


.21*1 


3.5!**** 


.610 


.1*96 


1.92 


.653 


.533 


.U38 


.518 


IMPRESS 


.1*01 


.31*6 


1.03 


.638 


.1*82 


2.61*** 


.1*60 


.172 


.323 


.126 


MELLOW 


.327 


.210 


2.38* 


.1*18 


.582 


-2.71*** 


.571 


.701* 


,238 


• >*97 


NIBBLE 


.290 


.5^9 


J* .73*** 


.397 


.61*5 


-1* .17*** 


.382 


.592 


.31*1 


.1*1*7 


OUTRAGE 


.130 


.228 


-2.32* 


.362 


.1*96 


-2.29* 


.1*23 


.1*56 


.1*10 


.551* 


OVERTURN 

• 


.586 


.1*69 


2.11* 


.681 


.1*96 


3.15** 


.1*65 


.1*62 


.272 


.071 


PARROT 


.611 


.136 


8.81**** 


.809 


.281* 


8.85*** 


• 5**7 


.1*87 


.637 


.1*1*5 


PENSION 


.080 


.056 


0.88 


.390 


.21*8 


2.55* 


• 501 


.632 


.237 


.1*11* 


PLANK 


.500 


.210 


5.1*6*** 


.501* 


.1*51* 


0.83 


• *4l5 


.1*69 


.200 


.506 


PRESSURE 


.31*6 


• 099 


5.35*** 


.1*75 


.298 


3.06** 


.631* 


.391 


.337 


.250 


SLEIGH 


.1*11* 


.321 


1.73 


.57*» 


.1*1*7 


2.11** 


.675 


• 519 


Ji29 


.1*1*6 


SPLINTER 


.660 


• 099 


10.1*2*** 


.716 


.220 


8.35*** 


.607 


. 3**5 


*525 


.225 


STRUCTURE 


.1*63 


.086 




.695 


.128 


9.68*** 


.631* 


.561* 


.565 


.182 


"Different 


" meanings : 


in H and L 


grammatical 


functions 










ANIMATE 


.173 


. °12 


1* .98*** 


.397 


.028 


7-57*** 


.1*81 


-.oil* 


.519 


. 3C1* 


BLOUSE 


.327 


.525 


-3.90*** 


.383 


.631 


-14 .17*** 


.508 


.1*58 


. 31** 


.260 


BUFFALO 


.281* 


.080 


1^75*** 


.1*1*7 


.227 


3.91*** 


.559 


.537 


.521 


.253 


FiOVEL 


512 


.302 


3.81**** 


.823 


.5^6 


5 .00*** 


• 571 


.1*06 


.1*11 


.062 


PRIMARY 


.123 


.235 


-2. ^*1** 


. 1*96 


.571* 


-1.31 


.558 


.501* 


.1*23 


.1*13 


TARRY 


.327 


.136 


1* .08*** 


.571* 


.128 


7.86*** 


.1*67 


.236 


.612 


.311* 



0 




Chapter VI 



Conclusions, Discussion, and Recommendat ions 

The Incidence of MGF (Mul t iple Grammatical Function) Words in English 

Even without any special investigation such as the present one, it 
would he oovious to anyone who gives thought to the matter that there are 
large numbers of words in the English language that (in either spoken or 
printed forms) can function in more than one grammatical part of speech 
without any change of form. In this respect English appears to be 
somewhat different from many other well-known languages, such as French, 

German, Spanish, or Russian, in which it is usually the case that a word 
presented in isolation can be immediately recognized by a native speaker 
as belonging to one and only one part of speech or grammatical function. 

For the purposes of the present study, it was nevertheless felt 
desirable to obtain more precise information on the incidence of FGF words 
in English. A 5 percent random sample of the first 10,000 words according 
to frequency in the Thorndike (1932) word-list was examined: of these %0 
words, about h3 percent were found to be grammatical ly ambiguous. A sinple 
extrapolation suggests that about ^300 words out of the most common 10,000 
words in English are grammatically ambiguous in the sense that they (i.e., 
their ’’base" or "dictionary entry" forms) may occur in more than one part 
of speech. Closer examination of the 5 percent sample disclosed that 
grammatical ambiguity had higher occurrence among the words of higher frequency. 
About T2 percent of the 1000 most common words, it may be estimated, 
may occur In more than one paid: of speech. 

The se data do not take account of the possible multiple mean i tvs 
of words. Independently of whether e word is grer.nwitic?' 1 ly ambiguous 
or urambiguous, it may have a number of different senses. It is veil 
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known that multiple meaning (polysemy) is more likely to occur among the 
more frequent words. To some unknown extent, our results may reflect 
the fact that high frequency words are more likely to have multiple 
meanings. The focus of this study, ho; 'ever, was on multiple grammatical 
function, or what may be called polysyntagmy . It was noteworthy that our 
studies found many words that could occur in more than one grammatical 
function but had essentially only one basic sense. 

The psychol ingui stic significance of polysyntagmy 

These findings have several important implications regarding the 
nature of competence in the English language. 

First, they imply that competence in English involves not only a 
knowledge of the basic meanings of words but also a knowledge of the 
possible grammatical functions of those words, and the limits of those 
functions. For example, it is a part of the usual competence of a 
native speaker of English to know that words such ns NAME, END, and 
FREE may be used in more than orr grammatical function: NAME and END 

as nouns and verbs, and FREE as either a verb or an adjective. But the 
native speaker must also know that there are constraints on the grammatical 
usages of words: he must know that LOUD and SORE, for example, cannot 
normally be used as verbs, for example. 

Second, these findings imply that in the production or comprehension 
of messages, the language user draws on his knowledge of the grammatical 
functions of words. In the normal understanding of a sentence, the language 
user hes to process the words in terms of his knowledge of their possible 
grammatical functions. If a newspaper ;eader, for example, were to 
see a headline such as FRENCH SHIF SAILS TONIGHT he could interpret it 
^ jther as meaning "The ship owned by the French is going to depart tonight ' 1 

ERIC 
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or as "The French people ara shipping their sails tonight" on the basis 
of his knowledge that ship and sails could be construed as either nouns 
or verbs, and that French could be taken as either an adjective or a 
noun* Of course, he might use other processes to determine which of 
these readings is the more likely interpretation in a particular context. 
Tut he could not even arrive at any reeding of tne sentence without using 
his knowledge of the possible grammatical functions of the words* It 
would thus seem important, in the study ol sentence comprehension, 
to assemble data on native speakers’ Knowledge about the grammatical 
usages of words * 

We know that in the domain of vocabulary there is considerable 
variation among native speakers in the extent of their knowledge. It 
is likely, therefore, that the various grammatical usages of individual 
words may be regarded as separate and independent phenomena that may 
be differentially known by a native speaker. A speaker who knows that 
a given void may occur in a certain part of speech will not necessarily 
know that it may also occur in another part of speech, or that it 
cannot occur in still another part of speech. If this is so, ve way 
expect speakers to differ in their ability to handle different grammatical 
usages in either the comprehension or the production of verbal messages* 
Also, we should expect that as children grow in language competence, 
they would gradually improve in their knowledge of specific grammatical 
usages . 

Tne present suioy was designed to investigate growth in children’s 
k now ledge c 1 gramma t i cal us ages of word s . 



o 
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The role of frequency 

Iii the introductory paragraphs above, we spoke of grammatical 
ambiguity in terms of whether a word T1 may T1 occur in more than one part 
of speech. The concept of frequency implied in that statement was that 
of "all-or-none . " That is, a word would be regarded as grammatically 
ambiguous if, according to linguistic convention, that word could be 
used acceptably in more than one part of speech, even if its use in one 
of those parts of speech were extremely rare. For example, the word 
ARE may be regarded as grammatically ambiguous because along with its 
extremely common use as a form of the verb BE one can also encounter, 
although very rarely, its use as a noun, denoting a unit of area in the 
metric system. 

Generally, the frequency with which some phenomenon occurs in 
large samples of language provides some guide as to the likelihood 
that s r eak rs of the language will be familiar with that phenomenon. 

An important feature of the earlier phases of this investigation, 
therefore, was an effort to obtain information un the relative frequencies 
with which the words in a representative sample of common words were 
used in different grammatical functions. Obtaining reliable information 
of this sort was found to be quite difficult, because the usual word- 
frequency counts do not honor distinctions of either meaning or grammatical 
usage. The Semantic Count developed by Lorge and Thorndike (1938) 
was found to be of some use, however, and was one of the bases for 
assigning provisional "MGF vectors 11 to a sample of 1220 words that were 
identified as being more or less common in English. These MGF vectors 
were intended as estimates of the parts in ten ( perdecems ) with which a 
A*‘*en word would be used in each of several grammatical functions 
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(generally, noun , verb , or adjective ) in a large corpus of speech or 
vi i ting in English. These MGE vectors are listed in Appendix A. 



j . *he collection of normativ e data on individuals' grammatical perceptions 
of MGF words 

It vas felt desirable, however, to obtain another kind of information 
on grammatical usages of words, namely, the usages that individuals 
would make of words most directly and spontaneously when presented with 
those words in isolation. It may be assumed that when a person is 
presented with a word in isolation, he will perceive it as being in a 
certain grammatical part of speech; given enough time, he may perceive 
it as possibly being in more than one part of speech, but his most 
immediate response to the word would presumably indicate the usage 
which 5s mos-> dominant for him in a hierarchy of habits. A simple way 
of detecting the person's grammatical perception of a word is to present 
it to h in in isolation and ask him to make up a sentence illustrating 
the word; the investigator can then, on jiispection of the sentence, 
usually determine the part of speech in which it was used, am i nfe rent i ally, 
the part of speech in which it was perceived, By collecting data of 
this sort from repr : xntative samples of respondents it Is possible 
to assemble normative data on the frequency with which given vorus 
are perceived in various parts of speech. 

Chapter IV of this report describes a study in vTiich sucl normative 
data were collected concerning 2k0 MGF v’ords. School-age children in 
grades 3, 6, and 9 contributed these data. By the use of sizable sample:, 
the reliability of these data was reasonably well assure;, except in the 



ERIC 



care of word? 
supply iiluso] 
"eve prt edited 



for which only mail numbers -of students were t b 1 e to 
: alive sentences. The extensive normative data thus a 
in tables accompanying Chapter IV, 



embica 



19G 

- 180 - 



A pilot experiment, described in Chapter III, provided evidence 
that virtually excluded the possibility that these normative data were 
in any way biased by "priming" or "set" effects whereby the grammatical 
perception or "parsing" of a given word would be influenced by the 
response to an Immediately preceding word in the list* 

In general, the normative data tended to show good correspondence 
with the provisional "MGF vectors" described above. The two sets of 
data exhibit some discrepancies, however. One possible reason for 
discrepancy is that the MGF vector data were estimated mainly from 
counts of words in adult reading material, whereas the normative data 
represent responses of children in grades 3> 6, and 9 that reflect 
their own perceptions and experiences with the words s Also, frequency 
of usage would not be expected necessarily to correspond exactly with 
grammatical perceptions of words presented in isolation* 

The normative data also included information on the tendency of 
children to use a word in two different parts of speech when asked to 
write two successive sentences using the word in different ways. It 
was found that this tendency was highly correlated with what may be 
called th= "balance" of the MGF vector, i.e., the extent to which 
it reflected more or less equally frequent multiple grammatical usages. 
Here, the "empirical" MGF vector was used as the data base: when several 
grammatical usages were likely to appear with approximately equal 
frequencies in the first sentences written by the children in the 
sample, there was a greater tendency for them to change grammatical 
part of speech in a second sentence than when the grammatical usages 
were concentrated in only one part of speech. 
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jlidse data unfortunately do not Indicate to what extent the 
respondents were aware of the change of grammatical function or 
deliberately made changes in grammatical function; their changing of 
p>&rt of speech in a second sentence might have occurred solely as a 
kind of chance, unconscious process. This interpretation is likely, 
in fact, in view of the finding that few children made more than a very 
small number (two or three) changes of grammatical function over the 
whole set of 26 or 27 words with which they were presented. 

Children's knowledge and comprehension of unusual grammatic el function :; 
of words 

The preliminary investigations described above operated to set 
the stage for the main study that was the goal of the project as a 
whole: a study of the extent to which children at several grade levels 
were able to comprehend words used in unusual grejnnaticai functions. 

From the normative data on children's perceptions of gr&jwva zi :a’ 
functions, 65 words were chosen for further study, These 63 words 
represented a wide range of difficulty and of types of grammatical 
ambiguity; their common characteristic, however, was that at least one 
of the grammatical usages vac infrequently found in the normative data, 
i.e.j the word was seldom used in one of the parts of speech when :he 
respondents were asked to use the word in a sentence. 

These words were employed in constructing two types of instruments 
to be used for assessing children’s knowledge and comprehension of the 
respective grammatical usages. One of these instruments, the Sentence 
: vaiiw.c-ion test, presented a w^rd in a sentence in either a "high freon. n 
''low frequency," or an "anomalous 11 usage, the child beii.g a kid to 



o 




198 

-190 - 



evaluate whether the word was correctly used or not. The rationale 
for this instrument was that if a child marked a "high frequency" 
or a "low frequency" usage as "correct / 1 but marked an 'anomalous" 
usage as "incorrect,” he was more likely to be able to understand the 
word. Actually, because of the way in which the forms of this test 
were constructed, any given child was presented with only one of the 
three usages — "high / 1 "low," or "anomalous /' The relative degrees 
to which the "high frequency" and "lew frequency" usages were comprehended 
by the group were assessed by comparing the responses of different 
subgroups, one subgroup having been presented with the "high frequency" 
usage and the other having been presented with the "low frequency" 
usage. The "anomalous" items were, in effect, "fillers" designed to 
give the respondents opportunity to find "incorrect" usages. 

The other type of instrument was a so-called Headlines test in 
which the word (in either a "high frequency" or a "low frequency" 
grammatical usage) was presented in the context of an imaginary "headline" 
such as might appear in a newspaper; the child was asked to write a 
paraphrase of the headline without using the key word, which was underlined. 
Comprehension of the word was assessed by judging the child f s success 
.In writing a paraphrase that showed his understanding of the word. 

There were, at each of three levels of difficulty, three forms of 
the Sentence Evaluation test and two forms of the Headlines testj in this 
way, different random samples of children responded to the different 
usages of the words. By comparing the proportions of correct or 
acceptable responses to the various usages, it was possible to investigate 
the main question for which this study was designed: do school-age children 
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have more difficulty in comprehending or using words in their less 
frequent grammatical functions? 

To the question stated in juso this way, the data gave a very 
clear answer: for about nine out of ten of the words studied, children 

do have significantly more difficulty with the less frequent grammatical 
functions, i.c., with the functions that they are; less likely to use 
when asked to make sentences illustrating the words. 

It was also clear that there were significant developmental trends: 
with increasing age and grade, children tended to have less and less 
difficulty with the infrequent grammatical usages. Nevertheless, even 
at grade 9* there were mary words for* which it was the case that the 
childrrn had significantly more difficulty with the less frequent grammatical 
usages than with the more frequent ones. 

These conclusions are based on the results from both of the tests, 
which tended to agree with each other. Nevertheless, the results were 
clearer end more striking from the Sentence Evaluation test, probably 
because this was a test that required only a simple judgment from the 
child as to whether the word was used correctly or not, whereas the 
response to the Headlines test was much more demanding, in that it 
required the child to write a paraphrase of a sentence without using 
the word whose comprehension was being tested. The proportions ox' correct 
responses to the Evaluation test were in general much higher than *he 
corresponding proport ions in the Headlines test. 

It was necessary, however, to assess the possible role of semantic 
factors as explaining either part or all of the differences in proportion, 
of correct responses. For some of the words it was evident, even in 
advance, that semantic differences were correlated with differences in 
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gramma tical function. For example, the meaning of HEDGE as a noun 
("a row of bushes”) has only a remote, metaphorical connection with its 
meaning as a verb in "to hedge one's statements." 

The results were classified on the basis of whether the different 
grammatical functions actually used in the Sentence Evaluation and Headlines 
tests had associated semantic differences. When this was done, it could 
be seen that there were three classes of results: 

( 1 ) Words for which there appeared to be no essential semantic 

differences correlate d with differences ir . grammatical function , and 
for which there was little evidence of significant differences in 
correctness of response : There were relatively few cases of this sort, 

mainly restricted to highly familiar, high frequency items. These 
were as follows: BROKE (vb., adj.); END (n., vb.); LINE (n., vb.); 

NAME (n., vb.); WISH (n., vb.); HUM (n., vb.); KNOT (n., vb., both 
referring to an interlacement of rope, cord, etc.); SCARE (n,, vb.); 

SPEAR (n., vb.); YELL (n., vb.); and OVERTURN (n., vb.). 

( 2 ) Vfords for which there appeared to be , as before, no essential 

semantic difference s correlated with differences in grammatical function , 
but for which there were rather consistent significant differences in 
correctness of response favoring the "high frequency” grammatical function : 
Following are the cases of this type; the "low frequency" usage is 
underlined and unabbreviated: AGE (n., verb) : FILL (vb., noun ) ; 

SIGHT (n., verb ) ; TAKE (vb., noun ) ; BOTHER (vb., noun ) ; BUBBLE (n., verb ) ; 
CHANNEL (n., verb); DRUG (n. , verb ): BUY (vb., noun ); POLL (n., verb ); 

WORRY (n. . verb): EPIDEMIC (n., adjective ); HOIST (n., verb); MELLOW 
(ad j . , verb ) ; NIBBLE (vb., noun); OUTRAGE (n., verb ) ; PENSION (n. , verb ) ; 
PLANK (n., verb ); PRESSURE (n., verb); SLEIGH (n., verb ); SPLINTER 
(n., verb); STRUCTURE (n., verb ). These may be considered cases that 
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confirm the general conclusion of this study that frequency or familiarity 
of grammatical function per se is often a critical factor in comprehension 
of language. 

{ 3 ) Words for which important semantic differences were correlated 
with differences in grammatical function , and for which there were 
rather consistent differences in correctness of response favoring the 
"high frequency 11 grammatical function : CHANCE (n., verb ) ; FREE (adj., "verb ) 

GAME (n«, adjective ) ; GRAVE (n., adjective ) ; LIVE (vb., adjective ) ; 

MILL (n., verb); PAGE (n*, verb ) ; PRIVATE (adj., noun ) ; SEASON (n., verb); 
SKIRT (n., verb); STRANGER (n., adjective ): TRAIN (n., verb); HEDGE 
(n,, verb); INCENSE (n.. verb ); MOTOR (n., verb ); PLANT] (n., verb ); 

POLICE (n., verb ) ; SNAKE (n. , verb); SWAMP (n., verb ) ; TWINE (n., verb ) ; 
ANIMATE (vb., adjective ); BLOUSE (n, , verb); BUFFALO (n., verb ), ECLIPSE ' 

( n . , verb ) ; IMPRESS ( vb . , noun ) ; NOVEL (n. , adjective ) ; PARROT ( n . , verb ) ; 
PRIMARY (adj., noun ) ; TARRY (vb., adjective ). 

To summarize, there were 11 words in class {?.), 22 words in class (;l), 
and 29 words in class ( 3 ). (One word ; APPEAL, does not appear in any 
of these classes because, through an oversight in the construction of 
the Sentence Evaluation test, the grammatical function was the same 
[r.oun — but with two different senses] in the two sentences that were 
Intended to contrast "he "high frequency" [verb] and "low frequency" 

[noun] usages.) 

As suggested above, class ( 2 ) is the critical one for this study. 

If only a negligible number of words had appeared in this class, one 
would be Inclined to reject the hypothesis that grammatical function 
per se (as opposed to semantic content) makes a difference in children's 
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comprehension of MGF words. With the appearance of at least 22 words 
in this class, however, there is considerable assurance that grammatical 
function can and does make a difference. Inspection of these results 
suggests that there are many words whose less frequent grammatical 
usages are less likely to be contained in the lexical-grammatical 
knowledge of children in the grade range 3 to 9* 

The presence of a consider able number of words in class (3) 
suggests that differences in semantic content can often be critical 
factors along with grammatical factors. This study was not designed 
to determine the effect of semantic factors with grammatical usage held 
constant, since it was felt that previous research had already shown, 
to an adequate degree, that such effects could be important. The only 
purpose of including such words in this study was to demonstrate that 
grammatical differences could accompany semantic differences and that 
the less frequent usages were more likely to pose difficulties in 
comprehens ion , 

There were, to be sure, 11 words in class (l) — words seemingly 
like those of class (2) in their semantic and grammatical characteristics 
but for which "high frequency" and "low frequency" usages were handled 
about equally well. However, most of these were words whose overall 
frequencies are themselves quite h.gh. 

Since this study could include only a relatively small number of 
MGF words in the final instruments, and since the 6j words selected 
represented a rather arbitral y sample, it is difficult to make generaliza- 
tions beyond this small sample of words. Presumably, similar results 
would have been obtained if all 240 words studied in the normative data 
O could have been employed in the main study, but even so, these 240 
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words are themselves a rather arbitrary sample of all the M 1 F words 
that might have been included. At any rate, no claim can be made that 
the frequencies vith which the 63 words fell into result-classes (l), 

(2), and (3) give any indications as to the "true” probabilities with 
which MGF words in general wou.ld fall into these classes. In any event, 
the results would depend partly on the particular items and sentences 
constructed to illustrate the words. 

V.’e can only repeat at this point the finding that a significant 
number (22 out of 63, or 35$) of the words studied fell into class (2) — 
in which difficulty correlated with grammatical function even in the 
absence of correlated semantic differences, a finding which leads to 
the conclusion that grammatical function per se can be an important 
factor in children’s lexical knowledge or competence. 

From a practical teaching standpoint, this means that t he less 
frequent p;ra mm atica 1 functions of words deserve special attention in 
the English j an^ua fro arts curr ieu.lum , even when there appear to be 
no important semantic differences correlated with differences in grorcj.iati :ui 
function. It may also imply that students need to have their att ention 
drawn to the fact that many words can have different grammat ical fu n: ti ons 
even without change of essential meaning . Perhaps it would be useful 
to design special teaching units to convey this fact and to tllustraU 
it. The general results of the present study imply th:it many of the 
difficulties that sehool-age children have in understanding English 
prose are connected with the fact that tncy do not possess lexicai- 
grammatical. knowledge about the less usual gra’wnutrud functions of the 
many words in English that can appear in more than one grarj-at 'cel funeti-rn. 
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The type of item constructed for the Sentence Evaluation test could 
readily be used in practical teaching situations, since such items are 
relatively easy to construct. Teachers could draw words from the lists 
of MGF words in Appendix A and construct sentences for high frequency, 
low frequency, and anomalous usages. Although very little attention has 
been paid in this report to the results for the "anomalous 11 usages, 
it may be worth pointing out here that (depending on the grade level 
and the difficulty of the words) "anomalous' 1 usages were marked as 
"correct 1 ' by around 10 to 15 percent of the children; obviously this 
represents misinformation or incorrect knowledge on the part of these 
children. 

Remarks cn the development of lex icogrammat leal knowledge 

The introductory chapter of this report included a brief discussion 
of possible processes in the development of the child's lexicogrammatical 
knowledge. From the little evidence bearing on this matter in the literature 
of early child language acquisition, it may be speculated that the 
following stages occur: 

(1) At the earliest stages of language acquisition (roughly, at 
the "one-word sentence stage"), words are used in terms of their semantic 
content, with no reference to their grammatical functions. 

(2) As the child begins to put words in grammatical constructions, 
he uses words in the grammat ical functions appropriate to those 
constructions (insofar as they can be determined), but this is mainly 
because their semantic content fits those constructions. For example, 
words used as nouns are primarily names of persons or concrete objects; 
words used as verbs are primarily words for actions; words used as 
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adjectives are primarily vords for certain tangible or readily perceivable 
qualities. The grammatical functions in which given words are used 
are severely limited, most words being used in only one grammatical 
function. Words which are grammatically ambiguous in the adult 
vocabulary (in the sense defined in the present study) are used almost 
exclusively in their "high frequency” usages. Nevertheless, the child 
at this stage is remarkably adept at detecting the grammatical function 
of a new word from its grammatical and semantic context. 

(3) As the child gains more virtuosity in grammatical constructions, 
he begins to experiment with new grammatical functions of the words he 
already knows, occasionally using nouns as verbs, or verbs as nouns, 

for example, This is done on the basis of the semantic content of the 
vords, however; when a noun is used as a verb, for example, it is implied 
that some action occurs with reference to the denotatum of the word 
as a noun. 

(4) When this "transfer" process results in a usage acceptable 

in adult speech, this usage tends to become confirmed and strengthened : 
ve may say that the child has acquired lexieogremmauical knowledge 
with respect to a given word such that thr- word is recognised to have 
more than one grammatical function. On the other hand, when the tiansfer 
process results in unacceptable usages, those usages tend to weaken 
am gradually drop out of the child* s repertoire. In such cases the 
grammatical information the child acquires about a word 1 in its its use 
to particular grammatical functions. 

(5) In later language development (up to grade 3 ; let us say), 




“lie child lcarnc the grammatical iJifoi'mation associated with the more 
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frequent words; on the basis of frequency of exposure, he learns the 
"high frequency” grammatical usages much more than the "low frequency 11 
ones. Most words are for him "grammatically unambiguous," i,e., they 
belong to only one part of speech or form-cla s, He has, as it were, 
learned not to invent grammatical usages that he has not heard in the 
speech of others. The words that are for him grammatically ambiguous 
are those in which two or more grammatical functions occur with high 
frequency in adult or peer language. These words may be fairly 
numerous, but they are still a small part of the child's total vocabulary 
at this stage. 

The present study was concerned with the development of lexi- 
cogrammetieal knowledge from grade 3 to grade 9 (corresponding roughly 
to ages of 8 to 14), While it was concerned mainly with the acquisition 
of "unusual 11 or "low frequency" grammatical usages, the normative data 
of Chapter IV clearly support the idea advanced in the previous paragraph 
that even by grade 3 the average child knows and uses a substantial 
number of words in two or more grammatical functions, but that these 
are in nearly every case words in which the two or more functions are 
of relatively high frequency in the adult vocabulary. On the other hand, 
the data clearly show that grade 3 children are far from adult (or even 
grade 9) standards in their knowledge of "low frequency 11 grammatical 
usages. From grade 3 to grade 9 there are developmental trends whereby 
children grow in their knowledge of low-frequency grammatical usages, 
but this growth is quite gradual. The average child at grade 9 still has 
rr,u?h to learn before approaching educated -adult standards. 

There is little or no evidence in our data of any sudden upturn 
the child's ability to handle multiple grammatical usages, That is. 
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it seems not to be the case that children acquire, at some point, a 
greater facility in handling MGF words i-n general . On the contrary, 
the data suggest that the acquisition of lexicogrammatical knowledge 
is a process whereby the child must learn specific grammatical usages 
of words item item. Since there is so much to learn — all the multiple 
grammatical functions of literally thousands of words — the process must 
necessarily appear gradual when viewed as a whole. We draw this cone* lus ion 
from the fact that the increments in percentages of correct responses 
from one grade level to another (as shown in Table 5*7) are generally 
quite moderate. 

The present data are limited, however, by the fact that they 
are of a cross-sectional nature and pertain to groups, not individuals. 

If there are indeed "sudden" upturns in the ability of individual children 
to deal with multiple grammatical functions in general, they would bo 
masked by the pooling of data from large numbers of children. 

A pri ori it seems unlikely that individual children would exhibit 
rapid and generalized development of on ability to handle multiple 
grammatical functions, simply because the adult norms regard irg MC! V 
words are extremely varied and subtle. It is difficult to construct 
linguistic rules governing what grammatical functions ore acceptable 
for given words* As with many other aspects of vocabulary knowledge, 
lexicogramnal ical knowledge must be acquired bit by bit and with 
reference is specific items. 

The main implication of this study is that lexicogrammatical 




knowledge — the knowledge of the acceptabi e grammatical functions of 
specific words — is a large component in language eonpeten :c w* that it 
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is acquired, slowly and, as it were, painfully. Children's deficiencies 
in lexicograrmiaticai knowledge undoubtedly account for a substantial- 
part of their diff icuities in understanding language. This is a fact 
that has apparently received grossly insufficient attention in the 
Engl i si language curriculum. 

It nay be pointed out, also, that standard word counts that do 
not recognize distinctions of meaning or grammatical function are 
practically useless in identifying low frequency meanings or grammatical 
functions that need to be taught if school-age children are to be 
brought to acceptable levels of the 1 ex icogi animat i cal knowledge they 
need for using language effectively. 
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APPENDIX A 



A List of Grammatically Unambiguous (UGF) and Ambiguous (MGF) Words 



Given first is the complete list of 1230 words that were involved 
in this study, in alphabetical order. Each word was assigned a number; 
the order of these numbers does not, however, correspond exactly to 
the alphabetical order because of certain cross-references that were 
controlled by the word numbers. Following each word is an indication 
of the sample (T, for Thorndike; H, for Harvard) from which each word 
was drawn. A few words, marked were not in the original samples 

but were derived from those vords; e.g., BUILDING was derived, from 
BUILD but separately listed. Next are G ive n the Dale ratings (D), the 
Thorndike Rank-Frequency Index (TH) > the full MGF vector, the grammatical 
type, the Semantic Code (SMCO), and an indication of which chapters in 
this report contain further data concerning the word ( 3 j 4 , and/or 5)* 

See Chapter II for further details. 

The complete alphabetical list is followed by lists of 
330 Grammatically Unambiguous Nouns, 

147 Grammatically Unambiguous Verbs, 

122 Grammatically Unambiguous Adjectives, 

468 Noun-Verb Words, 

64 Noun-Ad jective Words, 

23 Verb-Adjective Words, 

52 Noun-Verb-Adjective Words. 
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FORM J~A 



APPENDIX B. Sample Form Used in the Pilot Experiment of Chapter III, 



We want to f j nr! out how you and others in your grade use certain words. 

Look at each word and make up a short, complete sentence that shows how you 
might use it. Write the first sentence that you think of. 

Then, if you can think of other ways to use tie wo-d, write one or two more 
sentences . 

To give you the idea, here are some words that have already been put into 
sentences : 



ASHORE 

1, JL/L* . 

2. 



CAMP 



1 . 

2 . 

3 . 

1 . 

2. 

3 . 






LFA.S 







Nov try this one yourself: 
CROSS 



1. 



2 . 



3 , 



In the rest of thJs bookDet, write one, two, or three sentences U* each of the 
words that are given. It is up to you to decide how many sentences you write for 
each word. 




Please do not turn the page until you are told to do so. 
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FORM I ^ 1 



coinrrRY 



1. 

2. 

3. 



SAVAGE 

1 . 

2 . 

3. 



SEND 



1. 

2 , 

3. 



LIVE 



1. 



\> 9 

3. 



COUSIN 



1. 

2 . 

3. 



BLOSSOM 



1, 

2. 



3 ' o ■ 

ERJC 
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FORM IA-2 



REAL 

1. _ 

2. 

3 « 

GENERAL 

3., 

2 , 

3 . 

ENTER 

1 . 

2 . 

3 . 

FREE 

1 . 

2 , 

3 . 

EXPLAIN 

1 . 

2 . 

3 . 

GLANCE 

1 . 

2 . 



o 




3. 



FORM IA-3 



HONEST 



1 . 

2 . 

3. 

INSTANT 

1 . 

2 . 

3. 

afraid 

1. 

2 * 

3 . 

DIRECT 

1* 

2. 

3 * 

PRINCE 

1 . 

2 * 

3 . 

JUMP 



1. 

2. 
o 
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FORM 



i’ ft 



APPENDIX C. Sample Form Used in the Normative Study of Chapter IV. 

We want to find out how you and others in your graue use certain words. 



For each word write two short, complete sentences showing that you know how 
to use that word. Write the first sentence that you think of. Then, write 
another sentence using the word in a different way. 


To give you the idea, here are some words that have already been put into 
s entences : 


right 

1. 






2. 






paint 

1. 


a 




2 


o , % J 

/bs'ZVL. .V ,\2, ^iXit U 






' t 7 / 




clear 

1. 


dtidt- .xtu-n uv 




2. 




Now try 
rest 

1. 


7T 

this one yourself: 


7 


2. 







In the rest of this booklet, write two sentences for each of the words that 
are given. 



Please do not turn the page until you are told to do so. 
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1-A-l 



1* Jump 

1. 



2 . 

2. free 

1 . 

2 . 

3 . savage 

1 . 

2 . 

k . public 

1 . 

2 . 

?. kick 

1 . 

2. 

6, disease 

1 . 

2 . 

7, stranger 



1 . 



2 . 



3, slope 



1 . 



9. preserve 

1. 



O 

ERIC 
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l-A-2 



10. 


warm 




1. 

2. 


* 11. 


total 


4 


1. 

2. 


12. 


patient 

1 . . 

2. 


13. 


crowd 

2. 


14. 


sight 

1. 

2. — - 


15. 


game 

1. 


V 


2. 


16 . 

( 


fill 

1 . 


17. 


camp 

1. ■ 

2. - 


18 . 


green 

1. 


O 

ERIC 


2. . _ . 
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l-A-3 



19. train 

1. _ 

2 . 



20. due 

1. 

2 . 



21. nine 

1 . 

2 . 



22. pick 

1. 

2 . 



23. miss 

1. 



2 . 

lean 

1. 



2 . 



25. map 



1. _ 

2 . 



26. age 

1. _ 

2. 

27. take 

l._ 

ERIC ' 

hffliMffaHaaaa 
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APPENDIX n 

Results of the Main Study for Individual Words 

This Appendix actually presents a summary of normative data (as described 
in Chapter IV) and the comprehension test data (Chapter V) obtained on the 6 3 
words used in the Main Study. It also presents the actual sentences used in 
the Sentence Evaluation and Headlines tests, arranged in a manner to facilitate 
detailed study of the results. 

There is a page for each word, identified at the top. The first line 
below the identif iccvtion of the word gives the word number as assigned in 
Appendix A, the sample (S) from which it was drawn, the Dale rating (D), the 
Thorndike Flank-Frequency Index (TH), the Grammatical Code (GC), the Semantic 
Code fSKCO), and the MGF vector (N, V, a). This is immediately followed 
by normative data drawn from Table 4.3 concerning the parts of speech used 
when children at various grades are asked to write sentences illustrating the 
use of the word. (Normative data from Level 1, Grade 6 are included here 
even though they were not given in Table 4.3 because of the small N r s,) See 
Chapter IV for an explanation of these data. 

The bottom two-thirds of each page is devoted to the data from the to in 
Study (Chapter V). Proportions of correct, incorrect, and missing responses 
to "high frequency’ 1 (H), ’’low frequency" (l), and anomalous (A) usages in 
the Sentence Evaluation test are given; z-tests of the differences in 
proportions of correct responses to H and L usages are shown. The z-tests 
for grade comparisons for H, L, and A proportions of correct responses a^e 
then given (drawn from Table 5*7)- Similar data are then given for the 
Headlines test, but z-tests are shown not only for correct responses (R) but 
also for incorrect (w) and uninterpre table (?) responses. The z-tests for 
grade comparisons, however, refer only to proportions of correct responses. 
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RESULTS FOR INDIVIDUAL WORDS 
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DATA f pom FIRST SENTENCE WRITTEN — 2 NO SENTENCE 
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rs f-OR INDIVIDUAL WORDS 
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APPENDIX E 

Sample Forms Used in the Main Study: 

(1) Sentence Evaluation test (titled "Word Uses") 

(2) Headlines test (labeled Form H-1A) 

Note: The Sentence Evaluation booklet also contained 

25 items from the Wide Range Vocabulary Test, Form B, 
by C. R. Atwell and F. L. Wells, copyrighted 1937 by 
The Psychological Corporation. Because of copyright 
restriction, these items are not reproduced here. 
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NAME 



AGE FORM E - ify 



WORD USES 



This is a test of how well you know tre uses of certain words. 

Ijook at the following three sentences: 

A. They said it would be clear today. 

B. It is very blossom outside. 

C. We will paint in class today. 

The first sentence is marked RlGH'i because the underlined word lear , 
is correctly used. 

The second is marked WRONG because it does not make sense to use the 
underlined word, blosso m, in this way. 

The third sentence is marked RIGHT because the underlined word, paint , 
is used correctly in that sentence. 




Notice that tins test has nothing to do with whether 
true or not. 

Now here are some more examples for you to try: 


the sentences 


are 




The children are going to act in a movie. 


D. RIGHT 


WRONG 


h . 


The escape of the prisoner was not noticed 
until yesterday. 


K. RIGHT 


WRONG 


F. 


We learned how to large in class today. 


X. RIGHT 


WRONG 



Be sure to read every sentence careful . Decide whether the underlined 
word ii used correctly cr not. Put a circle around RIGHT or WRONG for 
each sentence. If you are not sure, give your best guess. 




Now you may open your test and begin. 



E - 1A 
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1. 


The hunters returned with a big take. 


i. 


RIGHT 


WRONG 


2. 


He told me his age. 


2. 


RIGHT 


WRONG 


3. 


They will work very fill to finish. 


3- 


RIGHT 


WRONG 


4. 


The man vas game for the race. 


4. 


RIGHT 


WRONG 


5. 


Can you stranger it? 


5. 


RIGHT 


WRONG 


6. 


We got free ccndy at the movie. 


6. 


RIGHT 


WRONG 


7. 


The driver said he would chance the race in the snow. 


7. 


RIGHT 


WRONG 


8. 


We had a very line work to finish. 


8. 


RIGHT 


WRONG 


9- 


Our car broke down during our trip. 


9. 


RIGHT 


WRONG 


10. 


Dogs always private the mailman. 


10. 


RIGHT 


WRONG 


11. 


The live is almos. ready to go. 


11. 


RIGHT 


WRONG 


12. 


The summer season will be here soon. 


12. 


RIC 7 


WRONG 


13- 


It vas a very grave problem. 


13- 


RIGHT 


WRONG 


14. 


The children fell asleep at the end of the day. 


14. 


RIGHT 


WRONG 


15. 


Our teacher will skirt the problem for now. 


15. 


RIGHT 


WRONG 


l6 . 


We used a train piece of string to tie the box. 


l6. 


RIGHT 


WRONG 


17. 


I have to eat very mill before mother comes back. 


17. 


RIGHT 


WRONG 


18 . 


We will read each page in the book carefully. 


18 . 


RIGHT 


WRONG 


19- 


Second graders can name the days of the week. 


19. 


RIGHT 


WRONG 


20. 


If you are lucky, you will sight a new star. 


20. 


RIGHT 


WRONG 


21. 


They were told to only wish for good things. 


21. 


RIGHT 


WRONG 



o 
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AGE 



FORM 
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DO NOT OPEN THIS BOOKLET UNTIL TOLD TO DO SO. 



This is a test of how well you understand newspaper headlines. 

Here is a sample headline: 

I . CLEAR WEATHER TODAY 

hhat does this mean? You could say it means „ "The weather will be sunny today." 
FOR EACH HEADLINE , WRITE A COMPLETE SENTENCE THAT EXPLAINS ITS MEANING. 



There 5s a special rule for this test: Each headline has one word underlined . 

In your explanation, you are not to use this word, or another form of it . 
You should find some different word or j>hrase to explain the meaning of 
the underlined word . 

In the example above, ue used the word "sunny" to explain the meaning of CLEAR . 
Here are more examples, with explanations already written: 



FIRST SPRING BLOSSOMS SEEN 




3. CHILDREN PAINT SNOW PICTURES 






I4. BABIES BEST AFTER EATING 







How try these: 

DOG LEFT BEHIND BY FAMILY 



C. WA'CHEHS SIGHT NEW STAR 



ERIC rLrr ^e r to *XPLAIN WHAT THE HEADLINE MEANS, and do not use the underlined word 
jkr * j ' i your sentence. 
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1. NO CHANCE TO SAVE LIVES IN FIRE 



2. PRIVATE GETS MEDAL 



3. MORE PEOPLE LIVE IN CITIES 



4. SALT USED TO SEASON FOOD 



5. BODY FOUND JN GRAVE 



< 3 . COUNTRY GOING BROKE 



ERIC 



TUDENTS WARNED NOT TO MILL ON STREET. 



120 
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8. FRONT PAGE OF NEWSPAPER NEVER DULL 



#■ 



> 



U. TEACHERS NAME BEST STUDENTS 



10. TEACHERS TO END GRADING OF STUDENTS 



1J . LONG LINE EXPECTED FOR NEW MOVIE 



12. WOMAN GETS SKIRT CAUGHT IN BUS DOOR 



13 . STUDENTS WISH SCHOOL YEAR OVER 



14. BOY ABLE TO TRAIN OLD DOG NEW TRICKS 

0 

ERIC — 



15. SIGHT GIVEN TO BLIND BOY 



16 . HUNTERS RETURN WITH BIG TAKE 



17. CHILD TELLS HIS AGE 



18. WORKERS FILL HOLE 



19. RUNNER GAME FOR RACE 



TO. MAN TELIS OF STRANGER THINGS TO HA1TEN 



T1 . FREE CANDY AT MOVIE 



o 

ERIC 



